Add automatic testing infrastructure #31
kWeglinskitest-pr.yml
on: pull_request
Unit Tests
26s
Integration Tests
25s
E2E & Visual Tests (Chromium)
2m 15s
Annotations
11 errors, 4 warnings, and 1 notice
|
Integration Tests
Process completed with exit code 1.
|
|
[chromium] › tests/e2e/translate.spec.ts:51:3 › Translate Flow › translate tab with text entered:
tests/e2e/translate.spec.ts#L57
6) [chromium] › tests/e2e/translate.spec.ts:51:3 › Translate Flow › translate tab with text entered
Error: A snapshot doesn't exist at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts-snapshots/translate-tab-with-text-chromium-linux.png, writing actual.
55 | await page.waitForTimeout(1500);
56 |
> 57 | await expect(page).toHaveScreenshot('translate-tab-with-text.png', {
| ^
58 | maxDiffPixelRatio: 0.05,
59 | });
60 | });
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts:57:5
|
|
[chromium] › tests/e2e/translate.spec.ts:45:3 › Translate Flow › screenshot - translate tab visual baseline:
tests/e2e/translate.spec.ts#L46
5) [chromium] › tests/e2e/translate.spec.ts:45:3 › Translate Flow › screenshot - translate tab visual baseline
Error: A snapshot doesn't exist at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts-snapshots/translate-tab-chromium-linux.png, writing actual.
44 |
45 | test('screenshot - translate tab visual baseline', async ({ page }) => {
> 46 | await expect(page).toHaveScreenshot('translate-tab.png', {
| ^
47 | maxDiffPixelRatio: 0.05,
48 | });
49 | });
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts:46:5
|
|
[chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors:
tests/e2e/translate.spec.ts#L13
4) [chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeVisible() failed
Locator: locator('text=English').first()
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for locator('text=English').first()
11 | test('display source and target language selectors', async ({ page }) => {
12 | const sourceSelector = page.locator('text=English').first();
> 13 | await expect(sourceSelector).toBeVisible();
| ^
14 |
15 | const targetSelector = page.locator('text=Spanish').first()
16 | .or(page.locator('text=French').first());
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts:13:34
|
|
[chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors:
tests/e2e/translate.spec.ts#L13
4) [chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeVisible() failed
Locator: locator('text=English').first()
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for locator('text=English').first()
11 | test('display source and target language selectors', async ({ page }) => {
12 | const sourceSelector = page.locator('text=English').first();
> 13 | await expect(sourceSelector).toBeVisible();
| ^
14 |
15 | const targetSelector = page.locator('text=Spanish').first()
16 | .or(page.locator('text=French').first());
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts:13:34
|
|
[chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors:
tests/e2e/translate.spec.ts#L13
4) [chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors
Error: expect(locator).toBeVisible() failed
Locator: locator('text=English').first()
Expected: visible
Timeout: 5000ms
Error: element(s) not found
Call log:
- Expect "toBeVisible" with timeout 5000ms
- waiting for locator('text=English').first()
11 | test('display source and target language selectors', async ({ page }) => {
12 | const sourceSelector = page.locator('text=English').first();
> 13 | await expect(sourceSelector).toBeVisible();
| ^
14 |
15 | const targetSelector = page.locator('text=Spanish').first()
16 | .or(page.locator('text=French').first());
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/translate.spec.ts:13:34
|
|
[chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check:
tests/e2e/languagecheck.spec.ts#L75
3) [chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBe(expected) // Object.is equality
Expected: 0
Received: 2
73 | await page.waitForTimeout(1000);
74 |
> 75 | expect(errors.length).toBe(0);
| ^
76 | });
77 | });
78 |
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts:75:27
|
|
[chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check:
tests/e2e/languagecheck.spec.ts#L75
3) [chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBe(expected) // Object.is equality
Expected: 0
Received: 2
73 | await page.waitForTimeout(1000);
74 |
> 75 | expect(errors.length).toBe(0);
| ^
76 | });
77 | });
78 |
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts:75:27
|
|
[chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check:
tests/e2e/languagecheck.spec.ts#L75
3) [chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check
Error: expect(received).toBe(expected) // Object.is equality
Expected: 0
Received: 2
73 | await page.waitForTimeout(1000);
74 |
> 75 | expect(errors.length).toBe(0);
| ^
76 | });
77 | });
78 |
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts:75:27
|
|
[chromium] › tests/e2e/languagecheck.spec.ts:38:3 › Language Check Flow › language check tab with text entered:
tests/e2e/languagecheck.spec.ts#L44
2) [chromium] › tests/e2e/languagecheck.spec.ts:38:3 › Language Check Flow › language check tab with text entered
Error: A snapshot doesn't exist at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts-snapshots/language-check-tab-with-text-chromium-linux.png, writing actual.
42 | await page.waitForTimeout(1500);
43 |
> 44 | await expect(page).toHaveScreenshot('language-check-tab-with-text.png', {
| ^
45 | maxDiffPixelRatio: 0.05,
46 | });
47 | });
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts:44:5
|
|
[chromium] › tests/e2e/languagecheck.spec.ts:32:3 › Language Check Flow › screenshot - language check tab visual baseline:
tests/e2e/languagecheck.spec.ts#L33
1) [chromium] › tests/e2e/languagecheck.spec.ts:32:3 › Language Check Flow › screenshot - language check tab visual baseline
Error: A snapshot doesn't exist at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts-snapshots/language-check-tab-chromium-linux.png, writing actual.
31 |
32 | test('screenshot - language check tab visual baseline', async ({ page }) => {
> 33 | await expect(page).toHaveScreenshot('language-check-tab.png', {
| ^
34 | maxDiffPixelRatio: 0.05,
35 | });
36 | });
at /home/runner/work/OmniPoly/OmniPoly/tests/e2e/languagecheck.spec.ts:33:5
|
|
Unit Tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Integration Tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E & Visual Tests (Chromium)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E & Visual Tests (Chromium)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
🎭 Playwright Run Summary
12 failed
[chromium] › tests/e2e/languagecheck.spec.ts:32:3 › Language Check Flow › screenshot - language check tab visual baseline
[chromium] › tests/e2e/languagecheck.spec.ts:38:3 › Language Check Flow › language check tab with text entered
[chromium] › tests/e2e/languagecheck.spec.ts:62:3 › Language Check Flow › page loads without errors in console on language check
[chromium] › tests/e2e/translate.spec.ts:11:3 › Translate Flow › display source and target language selectors
[chromium] › tests/e2e/translate.spec.ts:45:3 › Translate Flow › screenshot - translate tab visual baseline
[chromium] › tests/e2e/translate.spec.ts:51:3 › Translate Flow › translate tab with text entered
[chromium] › tests/e2e/translate.spec.ts:62:3 › Translate Flow › page loads without errors in console
[chromium] › tests/e2e/visual.spec.ts:8:3 › OmniPoly - Home Page › page loads and shows Translate tab
[chromium] › tests/e2e/visual.spec.ts:37:3 › OmniPoly - Home Page › tab navigation - switch back to Translate
[chromium] › tests/e2e/visual.spec.ts:57:3 › OmniPoly - Home Page › screenshot - full page visual baseline
[chromium] › tests/e2e/visual.spec.ts:64:3 › OmniPoly - Home Page › settings panel is visible on translate tab
[chromium] › tests/e2e/visual.spec.ts:77:3 › OmniPoly - Home Page › mobile viewport - layout adapts
12 passed (1.4m)
|