Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

when using a proxy like scrapoxy it seems that driver cut the connection because your connection is not private #222

Open
pbrns opened this issue Jan 25, 2025 · 1 comment

Comments

@pbrns
Copy link

pbrns commented Jan 25, 2025

From some test that I did, it seems that there an issue with proxies.
Even I put in the @browser a proxy like scrapoxy that supports many proxy management "http://xxxxxxxxx:xxxxxxxxxx@XX.XXX.XXX.XX:8888" also i tested with zyte "http://xxxxxxxxx:@api.zyte.com:8011" , all the connections it seems that cut because of connection is not private. (see the attachment)

Image

even if you put

  • cp scrapoxy-ca.crt /usr/local/share/ca-certificates/scrapoxy-ca.crt
  • update-ca-certificates

or do the same with zyte certification
and then

  • export REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt

it seems that with proxy there is an issue. I don't know what this happened, but didn't the driver need to have a verify property or having to give the path of custom certificate?

Any help it will be very helpful, because I sent many hours to learn the tools and use it and the most important part is that because I will have it in docker inside my VPS can't risk to have any port ban so need to have some proxy.

@pbrns
Copy link
Author

pbrns commented Jan 26, 2025

I manage to put in os with certutil the ca to pass from proxy lile scrapoxy and use the certificate. But don't need to have the verify and ca_cert property on the driver?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant