Scrapy Jobs

I have a Hungarian database that's open to the public without any login that I'd like scraped. Unfortunately, this database is extremely slow, tedious, and has "I'm not a robot" checks all the time. This makes it extremely difficult to even scrape it with Claude or any LLM. I'm looking for a creative individual that can pull this data for me and turn it into an Excel spreadsheet. There are going to be hundreds of thousands of data points in here. Please check out the website, and I have a comprehensive list of fields, basically every field that you can have to be scraped. This requires clicking through to the items and, in the majority of the cases, downloading a PDF and parsing that PDF as well. I am open to very creative ideas. Website: I'm also add...

I want a self-contained software agent that, when I feed it the name or domain of a medium-sized enterprise, automatically pieces together the company’s full organisational chart and returns a verified corporate email and number for every person it finds. The agent may explore open data reservoirs—our internal databases, public directories and employee social profiles—but it should not rely on any authenticated endpoints, API keys or user log-ins. You are free to choose the language and stack, though Python plus libraries such as Scrapy, Beautiful Soup, Selenium or similar web-automation tools would make sense. The final output needs to be delivered in both machine-readable (JSON or CSV) and human-friendly form: a hierarchical tree or graph that clearly shows reporting ...

I need a robust, fully automated process that pulls three specific data sets from Amazon every single day: • Product details (titles, bullet points, specs, ASIN, images) • Customer reviews with ratings and timestamps • Current pricing, including promotions and historical price if visible The solution should run on a schedule without manual intervention, gracefully handle captchas or page-layout changes, and drop the results into a clean, structured file or database table I can query—CSV or JSON is fine. Accuracy and consistency matter more than sheer speed; if a product page fails on one run, the script should log the error and retry. I’m comfortable working with Python, so Scrapy, Requests/BeautifulSoup, or Selenium are all acceptable. If you prefer ano...

I need a robust script or small application that can automatically collect every publicly available resume it finds for Las Vegas-based candidates on Indeed, LinkedIn, Glassdoor, and any other open sites or resume repositories you know of. For each profile the scrape should capture the person’s name, phone number, email address, and any stated work-experience details. Scope • Boards: Indeed, LinkedIn, Glassdoor are mandatory; feel free to add Craigs list, CareerBuilder, or niche sites as long as they host downloadable resumes or profile data. • Industries: no narrow filter—I’m interested in technology, healthcare, finance, hospitality, construction, and any “various jobs” you come across. • Geography: restrict to the greater Las Vegas are...

I need a fully-functioning lead-generation and sales operating system tailored to my granite and stone business and restricted to prospects located in Pune city. Core requirements The engine must scrape business directories—e-GEM, CPPP and Construction DATA—then run the results through an AI contact-finder so every record contains up-to-date phone numbers, emails, firm name, address and any other key business details. Accuracy and freshness are critical because the database will feed my outbound sales campaigns. Preferred flow 1. Automated scraping from the three directories on a schedule I can adjust. 2. AI-based enrichment and de-duplication immediately after each crawl. 3. Export to a clean CSV or direct sync with the CRM I specify. 4. Simple dashboard where I ca...

I already have flat-image mock-ups of every page, so the visual side is locked in; I simply need those screens turned into a clean, responsive informational website. Beyond the front-end build, the key requirement is a small data-puller that copies selected product details—title, price, image, brief description, and the original link—from one external e-commerce site (we’ll confirm which one once the project starts). The feed only has to refresh once every three months, so a lightweight scraper or API call that I can trigger manually or via a cron job is fine. Please: • Recreate each page exactly as shown in my images (HTML5/CSS3/JS or a framework you prefer). • Build a simple admin or script where I can run “update” and watch the catalogue...

I want a custom application that mimics the core strengths of Tactical Arbitrage but focuses on the Turkish market. The tool must scrape or fetch data from , and , then compare identical or highly similar SKUs to reveal profitable opportunities. Key capabilities I need baked in: • Accurate product-to-product price comparison across the three sites • Automatic profit margin calculations that factor in fees, shipping or any other costs I can define through a settings panel • A simple sales-trend module so I can see how each item has moved over the past weeks or months and spot consistent winners I’m happy with a cron job, Windows Task Scheduler or any lightweight scheduler you prefer, as long as the update cadence is reliable and I can trigger a manual refre...