Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Downgrade version of base docker image to alpine3.18 to resolve lib compatibility with Chromium #253

Merged
merged 2 commits into from
Dec 14, 2023

Conversation

younglim
Copy link
Collaborator

@younglim younglim commented Dec 14, 2023

This PR adds...

  • Drop the version of lts-alpine docker image from (latest) 3.19 to 3.18 due to compatibility issues with Chromium from starting in docker
  • Error log:
[pid=63][err] Error relocating /opt/ms-playwright/chromium-1091/chrome-linux/chrome: posix_fallocate64: symbol not found
{"timestamp":"2023-12-14 07:31:16","level":"error","message":"uncaughtException: Failed to launch browser. Please check the following:\n- Try installing the required dependencies by running `npx playwright install --with-deps` (https://playwright.dev/docs/browsers).\n\nThe original error is available in the `cause` property. Below is the error received when trying to launch a browser:\n​\nFailed to launch browser. Please check the following:\n- Try installing the required dependencies by running `npx playwright install --with-deps` (https://playwright.dev/docs/browsers).\n\nThe original error is available in the `cause` property. Below is the error received when trying to launch a browser:\n​\nbrowserType.launchPersistentContext: Target page, context or browser has been closed\nBrowser logs:\n\n<launching> /opt/ms-playwright/chromium-1091/chrome-linux/chrome --disable-field-trial-config --disable-background-networking --enable-features=NetworkService,NetworkServiceInProcess --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-back-forward-cache --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-background-pages --disable-component-update --no-default-browser-check --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=ImprovedCookieControls,LazyFrameLoading,GlobalMediaControls,DestroyProfileOnBrowserClose,MediaRouter,DialMediaRouteProvider,AcceptCHFrame,AutoExpandDetailsElement,CertificateTransparencyComponentUpdater,AvoidUnnecessaryBeforeUnloadCheckSync,Translate,HttpsUpgrades --allow-pre-commit-input --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-backgrounding --force-color-profile=srgb --metrics-recording-only --no-first-run --enable-automation --password-store=basic --no-service-autorun --export-tagged-pdf --disable-search-engine-choice-screen --headless --hide-scrollbars --mute-audio --blink-settings=primaryHoverType=2,availableHoverTypes=2,primaryPointerType=4,availablePointerTypes=4 --no-sandbox --proxy-server=http://127.0.0.1:33991/ --proxy-bypass-list=<-loopback> --disable-gpu --no-sandbox --disable-dev-shm-usage --disable-blink-features=AutomationControlled --user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 --user-data-dir=/tmp/playwright_chromiumdev_profile-fFngdD --remote-debugging-pipe about:blank\n<launched> pid=63\n[pid=63][err] Error relocating /opt/ms-playwright/chromium-1091/chrome-linux/chrome: posix_fallocate64: symbol not found\nCall log:\n  - <launching> /opt/ms-playwright/chromium-1091/chrome-linux/chrome --disable-field-trial-config --disable-background-networking --enable-features=NetworkService,NetworkServiceInProcess --disable-background-timer-throttling --disable-backgrounding-occluded-windows --disable-back-forward-cache --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-background-pages --disable-component-update --no-default-browser-check --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=ImprovedCookieControls,LazyFrameLoading,GlobalMediaControls,DestroyProfileOnBrowserClose,MediaRouter,DialMediaRouteProvider,AcceptCHFrame,AutoExpandDetailsElement,CertificateTransparencyComponentUpdater,AvoidUnnecessaryBeforeUnloadCheckSync,Translate,HttpsUpgrades --allow-pre-commit-input --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-backgrounding --force-color-profile=srgb --metrics-recording-only --no-first-run --enable-automation --password-store=basic --no-service-autorun --export-tagged-pdf --disable-search-engine-choice-screen --headless --hide-scrollbars --mute-audio --blink-settings=primaryHoverType=2,availableHoverTypes=2,primaryPointerType=4,availablePointerTypes=4 --no-sandbox --proxy-server=http://127.0.0.1:33991/ --proxy-bypass-list=<-loopback> --disable-gpu --no-sandbox --disable-dev-shm-usage --disable-blink-features=AutomationControlled --user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 --user-data-dir=/tmp/playwright_chromiumdev_profile-fFngdD --remote-debugging-pipe about:blank\n  - <launched> pid=63\n  - [pid=63][err] Error relocating /opt/ms-playwright/chromium-1091/chrome-linux/chrome: posix_fallocate64: symbol not found\n\n    at async PlaywrightPlugin._launch (/app/node_modules/@crawlee/browser-pool/playwright/playwright-plugin.js:105:40)\n    at async BrowserPool._launchBrowser (/app/node_modules/@crawlee/browser-pool/browser-pool.js:465:29)\n    at /app/async /app/node_modules/@crawlee/browser-pool/browser-pool.js:274:37\nError thrown at:\n\n    at PlaywrightPlugin._throwAugmentedLaunchError (/app/node_modules/@crawlee/browser-pool/abstract-classes/browser-plugin.js:145:15)\n    at PlaywrightPlugin._throwOnFailedLaunch (/app/node_modules/@crawlee/browser-pool/playwright/playwright-plugin.js:161:14)\n    at /app/node_modules/@crawlee/browser-pool/playwright/playwright-plugin.js:106:33\n    at async PlaywrightPlugin._launch (/app/node_modules/@crawlee/browser-pool/playwright/playwright-plugin.js:105:40)\n    at async BrowserPool._launchBrowser (/app/node_modules/@crawlee/browser-pool/browser-pool.js:465:29)\n    at async /app/node_modules/@crawlee/browser-pool/browser-pool.js:274:37"}
  • I've kept this PR as small as possible (~500 lines) by splitting it into PRs with manageable chunks of code
  • I've requested reviews from 1 reviewer
  • I've tested existing features (website scan, sitemap, custom flow) in both node index and cli
  • I've synced this fork with GovTechSG repo
  • I've added/updated unit tests
  • I've added/updated any necessary dependencies in package[-lock].json npm audit, portable installation on GitHub Actions

@younglim younglim changed the title Drop version to alpine3.18 to resolve lib compatibility with Chrome Downgrade version of base docker image to alpine3.18 to resolve lib compatibility with Chrome Dec 14, 2023
@younglim younglim merged commit 9b85f1e into master Dec 14, 2023
@younglim younglim changed the title Downgrade version of base docker image to alpine3.18 to resolve lib compatibility with Chrome Downgrade version of base docker image to alpine3.18 to resolve lib compatibility with Chromium Dec 14, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant