Digitalisation5 min read
Collecting Industry Data with Octoparse: What the Free Plan Does and What Is Allowed
Octoparse pulls data from web pages into a table without coding. Free plan limits, the steps for a first task and the legal limits of scraping other people's sites.
- #digitalisierung
- #web
- #tools
Octoparse is a program that pulls data from web pages into a table without any coding: you open a page in its built-in browser, click the fields you want, and the program collects them across many pages. For a small business this can be handy, for example to capture prices from a supplier catalogue or entries from a trade directory. Before starting the first task, though, it helps to know what the free plan actually offers and where the legal limits are.
What the free plan includes
According to Octoparse's pricing page, the Free plan covers ten tasks, one device and one user. You can export up to 50,000 rows of data a month, with no more than 10,000 per export. Formats include Excel, CSV and JSON.
What is missing matters more than the row count. The plan comparison in the help centre lists neither cloud extraction nor scheduled runs for the Free plan. Every task therefore runs locally on your own computer, at most two at a time, and only while the computer is on and the program stays open. Automatic IP rotation starts with the Standard plan, which the pricing page says begins at 69 US dollars a month when billed annually.
First question: which data may you collect?
A page being publicly accessible does not mean its content can be copied freely. In Germany, three points matter most:
- Database rights: Whoever built a database, such as a trade directory or a product catalogue, has the exclusive right under Section 87b of the German Copyright Act to reproduce it in whole or in substantial parts. Repeated, systematic copying of small parts can also count. Pulling an entire third-party directory is therefore risky. The rule implements the EU Database Directive, so similar protection exists across the EU.
- Text and data mining: Section 44b of the same Act allows copies for automated analysis, for instance to find trends or patterns. The copies have to be deleted once they are no longer needed, and the permission does not apply if the rights holder has reserved it in machine-readable form for online content.
- Personal data: Names, email addresses and phone numbers of contacts are personal data. Collecting them requires a legal basis under the GDPR, and under German competition law (Section 7 UWG) sending marketing emails to collected addresses generally requires prior consent.
On scraping itself, Germany's Federal Court of Justice ruled in the Ryanair case in 2014 that automatically reading flight data is not unfair competition merely because it breaches a website's terms of use. Overcoming technical protection measures, on the other hand, may be unfair (LTO on judgment I ZR 224/12, in German). In practice: you do not get around blocks, CAPTCHAs or login walls. Anyone who needs the data for more than an occasional overview should check with a lawyer first. This article is not legal advice.
Building a task step by step
The steps below follow the beginner tutorial in the help centre, using the labels as they appear in the program.
- Install and sign in: The desktop application is available from octoparse.com. A free account is enough for the Free plan.
- Create a task: Enter the address of the target page in the search bar and click "Start". The page opens in the built-in browser.
- Let it detect the data: Choose "Auto-detect web page data" in the Tips panel. Octoparse suggests fields such as name, price or link. In the data preview, use the bin icon to remove what you do not need, and give the remaining columns sensible names.
- Include more pages: If the page loads more items as you scroll, tick "Add a page scroll". If the list is split across several pages, enable "Paginate to scrape more pages" and check that the right next-page button is highlighted.
- Create the workflow: "Create workflow" generates the sequence. The tutorial recommends clicking through it once, step by step from top to bottom.
- Run it locally: Start the task locally and watch whether the data comes through.
- Export: In the task list, open the task's status, click "Export Data" at the bottom and choose a format.
For pages with a "Load More" button there is a separate guide. It shows how to set the number of clicks and how long Octoparse waits for new items after each click. If many duplicate rows appear, the guide suggests rearranging the workflow so that all items load first and are read afterwards.
When the site blocks you
Some sites slow down or block requests that arrive too quickly. Adding a free proxy service or getting around the CAPTCHA may look like the obvious fix, and both are a bad idea. Free proxies are unreliable, and they route your traffic through servers run by people you do not know. A block or a CAPTCHA is also exactly the kind of technical protection measure that the German court said it may be unfair to overcome.
It is more sensible to query more slowly, fetch fewer pages at once, or ask the provider. Many directories and suppliers offer export files, price lists or an API, and that is usually cleaner than any scraping.
When Octoparse fits and when it does not
The program works well for occasional, modest data collection: a list of publicly available data that you refresh once a quarter and then work with in Excel. Ten tasks and 50,000 rows a month are usually enough for that.
It is a poorer fit when data needs to flow daily and automatically, because without cloud runs and scheduling someone has to start the task by hand. Pages behind a login, shops with active bot protection, and platforms whose terms explicitly forbid automated reading and enforce this technically are not a case for the Free plan either. If your task is heading in that direction, a request to the data provider usually gets you there faster than a paid scraping plan.
Read next
Organisation
Digital Organization for SMEs 2026: Tools and Strategies Against Chaos
In 2026, digital organization is key for SMEs: Explore practical tools, AI integration, and web strategies that minimize daily chaos and boost productivity. From Notion to Fraunhofer insights – actionable for freelancers and small teams.
Web & tools
Best Productivity Tools 2026: Slack AI, Figma & More for SMEs
Discover top web tools 2026 like Slack AI and Figma for efficient collaboration in SMEs and freelancers. Practical tips for everyday use.
Web & toolsAdvertisement from Log-Studio (log-studio.de)
Browser DevTools for Your Company Website: Checking Speed, SEO and Accessibility Yourself
Browser developer tools show which files slow a page down, whether titles and descriptions are in place and where contrast is too low. What Network, Lighthouse and the rest can do, and where they stop.