Dark Logo
Dark Logo

Lisa Whelan

Contact author

Lisa is a London-based tech expert and AI enthusiast. With a decade of experience, she specializes in writing about data, web scraping, and cybersecurity. She's here to share valuable insights and break down complex technical concepts for the SOAX audience.

What is a transparent proxy and how does it work?

A transparent proxy is a kind of forward proxy, because it forwards requests from your device to the internet. It's called "transparent" because it does not alter your request before forwarding it to the online resource you are trying to use. This means that sometimes you may not even know your traffic is being routed through a transparent proxy.

What is a backconnect proxy, and how do they work?

Backconnect proxies are useful for web scraping activities like market research or ad verification that are otherwise challenging due to bot or IP blocks.

Web crawling vs. web scraping - What’s the difference?

Web crawling and web scraping are related concepts, but they serve different purposes in the context of retrieving information from the internet. Web crawling is the term for scanning and indexing web resources (usually web pages, but also videos, images, PDFs and other files), while web scraping is the targeted extraction of specific information from those resources.

Dolphin Anty review - A powerful anti-detect browser

Dolphin Anty is an anti-detect browser that is customized for affiliate marketing. Dolphin Anty gives you the power to manage multiple accounts on various platforms while ensuring those platforms can’t detect that your traffic is coming from a single source. People typically use Dolphin Anty to manage affiliate marketing accounts, although its applications extend to social media, ecommerce, cryptocurrency, advertising, and beyond.

Learn how to track an IP address, and why you'd want to

Tracking an IP address can help you gather information about the physical location of a device that’s connected to the internet. It can also reveal some technical and contextual information, such as whether the device is being used for residential or commercial purposes.

How to bypass CAPTCHA for web scraping

CAPTCHA systems are designed to look for patterns that distinguish bots from humans. By injecting randomness and human-like behavior into your scrapers actions, you make it much harder for these systems to tell the difference, reducing the chances of being blocked.

How to bypass an IP ban (IP blocking explained)

Websites, games, and applications can block a specific IP address, which prevents anyone using that IP address from accessing their service - this is called an IP ban. These bans can make it much harder to scrape public data or access online content.

How to scrape data from Amazon: The beginner's guide

Learning to scrape product data from the Amazon website can seem complex at first, but you can simplify the process by using a scraper API, so you don’t have to build a scraper or manage proxies yourself. Here’s a step-by-step guide on how to get data from Amazon using a scraper API, like the one provided by SOAX.

Forward vs. reverse proxies - What’s the difference?

When you navigate the internet, your device doesn’t always connect directly to the destination server. Instead, requests are often routed through a proxy before reaching their destination. Proxies come in two primary types: forward proxies and reverse proxies. A forward proxy sits between the client you’re using (for example, your web browser) and forwards its requests to the internet, while a reverse proxy sits in front of the destination server (for example, the server that holds a website’s data), and handles incoming requests.

How to scrape eBay: A step-by-step guide for beginners

As the second most visited online marketplace in 2023, eBay accumulates vast amounts of useful data for entrepreneurs, marketers, researchers, and others. By scraping eBay data in real time, you can get up-to-date information for you to analyze in whatever way best suits your business. For example, a small seller on eBay can use eBay data to optimize their pricing strategy, while a market researcher can use it to track consumer trends.

How to scrape a website using Python: Step-by-step guide for beginners

This guide shows you how to use Python to scrape data from two websites: a static bookstore with over 1,000 titles, and a dynamic quotes site that changes its content based on how people interact with it.

How to get a sneaker bot: A complete guide for beginners

Sneaker bots are software programs that automate the process of buying sneakers online. Find out more in our latest guide.

How to scrape a website with Selenium: Step-by-step guide for beginners

Selenium is an open-source framework that allows you to control a browser programmatically. It’s a powerful tool for extracting data from websites, especially if you want to scrape a website that relies heavily on JavaScript or has a complex structure (e.g., websites with dynamic content, interactive elements, or nested HTML).

How to scrape Google Search with Python (Step-by-step guide)

Google Search results, also known as SERPs, contain valuable data such as keywords, ad listings, and rankings. Analyzing this data can improve marketing strategies. Python is a practical tool for accessing and extracting this information. By scraping Google Search, you can uncover competitor data, optimize keywords, and enhance campaigns.