Web Scraping Timeout

This page provides detailed troubleshooting steps for resolving timeout errors when using web-based translation services in VNTranslator. Timeout errors are the most common issue with web scraping methods and occur when the virtual browser cannot find the translated text within the specified time limit.


What is a translation timeout?

A translation timeout occurs when VNTranslator cannot retrieve a translation within the specified time limit. This is most common when using web-based translation services.

How it works:

  1. VNTranslator opens a virtual browser window and navigates to the translation website

  2. The text is submitted either by:

    • Entering it directly into the translation input field, or

    • Including it in the URL

  3. VNTranslator continuously searches for the translated text in the page's HTML elements

  4. If the translation is not found within the timeout period (default: 10 seconds), a timeout error occurs

By default, the Translation Timeout is set to 10000ms (10 seconds). You can increase this in Settings → Translation → Advanced Settings.


Translation services that use web scraping

The following services use web scraping methods and may experience timeout errors:

  1. Google Lite

  2. Google Web

  3. DeepL Web

  4. Bing

  5. Papago

  6. Yandex

  7. Baidu

  8. ChatGPT Web (webLLM)

  9. Gemini Web (webLLM)

  10. Claude Web (webLLM)

  11. Mistral Web (webLLM)

  12. DeepSeek Web (webLLM)

  13. Grok Web (webLLM)

What's the difference between web-based and API services?

Web-based services (listed above) don't have "API" in their name and use browser automation. API services like "DeepL API" or "Gemini API" use official connections and are more reliable.


What causes translation timeouts?

Translation timeouts can occur due to several reasons:

Service-related issues:

  • Website structure has changed (translation service updated their layout)

  • Website is under maintenance or temporarily unavailable

  • CAPTCHA verification is required

  • Cookie consent banner is blocking content

  • Free usage limit reached

Connection issues:

  • Unstable or slow internet connection

  • Your IP address has been blocked or rate-limited by the service

  • Too many translation requests sent in a short time

Browser issues:

  • Virtual browser fails to load the page correctly

  • JavaScript elements not loading properly


Troubleshooting Steps

1. Check for Translation Service Updates

Make sure your Translation Service is up-to-date.

  • PRO Version: Go to Settings → Translation Services → Updates

  • NEO Version: Check the #custom-mt channel on Discord for updates

2. Avoid the "Detect Language" Option

While this option is available, using "Detect Language" is not recommended as it may cause compatibility issues in some updates. It's better to manually select your source language for more reliable results.

3. Inspect the Virtual Browser Window

Enable "Show Browser" in Service Settings to visually inspect the web scraping process and identify what's causing the timeout.

To open Service Settings:

  • From Launcher: Launcher → Translator → Double-click on the Service Name

  • From Settings: Settings → Translation Services → Click on the Service Name

If a CAPTCHA Appears Too many requests may trigger a CAPTCHA. Complete the CAPTCHA verification or use a VPN to get a different IP address.

CAPTCHA

If a Cookie Banner Appears Accept or decline the cookie banner, especially if you are in the EU or another region where these banners are displayed. The banner can block the translation from appearing.

If You See a "Free Usage Limit Reached" Message Clear Cookies or restart MT. If this doesn't work, try using a VPN.

If the Page Fails to Respond or No Translation Appears This may be caused by too many requests. Clear Cookies or restart MT. If this doesn't work, try using a VPN.

You can watch this video, which demonstrates an example of the "too many requests" issue: https://www.youtube.com/watch?v=JdhLtNgVdYc

If the Page Loads Incorrectly or Appears Blank This may indicate an unstable internet connection or that the translation website is under maintenance. Try:

  • Checking your internet connection

  • Waiting a few minutes and trying again

  • Switching to a different translation service temporarily

If You Can See Source and Translated Text in the Virtual Browser Window but VNTranslator Still Shows TIMEOUT This likely indicates a website structure update. VNTranslator can no longer find the correct HTML elements where the translation appears.

What to do:

  • Report this issue in the #report-an-issue channel on Discord

  • Use an alternative translation service temporarily while waiting for an update

4. Clear Browser Cookies and Site Data

Clearing cookies can resolve many timeout issues, especially when you've hit usage limits or your session has expired.

5. Use a VPN

If you're experiencing rate limiting or IP blocks:

  • Connect to a VPN and select a different country

  • Clear cookies after connecting to the VPN

  • Retry the translation

6. Switch to API-Based Services

If web scraping continues to fail frequently:

  • Consider switching to API-based alternatives ("DeepL API" to "Gemini API")

  • API services are more reliable and faster

  • Most services offer free tiers or affordable pricing