I'm trying to build a Python scraper in Jupyter Notebook to collect Hyderabad IT company leads and export them to Excel.
What I need:
My current setup:
My exact search query:
site:linkedin.com/company Hyderabad technology company "11-50 employees"
This exact query works manually in Google. My browser shows actual company pages such as Zodeck Technologies, Zeominds IT Solutions, DE FINGERS, and Techeduxon, with company size and Hyderabad location in the snippets.
However, when I send the same query through SerpApi, I get unrelated results like RevenueBase, Glassdoor, Crunchbase, Facebook posts, and YouTube videos.
The API returns HTTP 200, status Success, and no search error. It reports 51 results, but the first 10 results are mostly irrelevant.
I also tried:
Google through SerpApi
Bing manually
Different queries and employee ranges
Filtering results to LinkedIn company URLs
Checking the API response metadata
Filtering doesn't solve the problem because the actual company pages I need aren't appearing in the API results.