Python Developer

Are you an experienced Python developer with a talent for web scraping and API data extraction? Do you excel at writing scalable and efficient scripts? We are looking for a skilled professional to join our team and create robust Python scraping scripts for a variety of data sources. If you have a passion for clean code and delivering results, this is the opportunity for you!

To Apply, please complete the form here: https://forms.gle/KZTDnEt871Y9bt3J8
---

Responsibilities:

Develop API Scraping Scripts

- Write Python functions to extract data from specified sources (list provided).
- Ensure scripts handle large-scale data scraping (100K+ profiles daily).
- Incorporate timestamp-calculated header values, pagination, and proxy requirements to avoid rate limits.

Code Quality & Documentation

- Deliver clean, well-documented Python code for future use and maintenance.
- Provide sample results to verify script functionality and quality.

Collaboration & Reporting

- Share progress and code updates through Google Colab.
- Coordinate with the team for feedback and refinements.

---

Qualifications:

Proficiency in Python: Strong coding skills and familiarity with Python libraries for web scraping (e.g., Beautiful Soup, Selenium, or Scrapy).
Experience with APIs and Data Extraction:** Demonstrated ability to extract data from APIs and websites efficiently.
Knowledge of Apify: Ability to reference Apify scrapers for desired functionality.
Attention to Detail: Ensure robust error handling and optimization for large-scale data extraction.
Independent Worker: Capable of working autonomously while meeting deadlines.

---

Sources to Scrape

**Apollo.io**

- Extract a list of profiles from search URLs.
- Example: [Apollo Search](https://example.com/)
- Apify Reference: [Apollo.io Scraper](https://apify.com/curious_coder/apollo-io-scraper)

**Twitter**

- Extract tweets and author profiles or single profiles by handle/account ID.
- Example: [Twitter Query](https://x.com/search?q=wikipedia&f=live&src=typed_query)
- Apify Reference: [Twitter Scraper](https://apify.com/quacker/twitter-scraper)

**LinkedIn**

- Extract individual profiles by slug or account ID.
- Example: [LinkedIn Profile](http://linkedin.com/in/greghurrel)
- Apify Reference: LinkedIn Scraper

**GitHub**

- Extract user profiles by username or account ID.
- Example: [GitHub Profile](https://github.com/wincent)

**Crunchbase**

- Extract individual or organization profiles by slug or account ID.
- Example: [Crunchbase Profile](https://www.crunchbase.com/person/marc-bresseel-de22)
- Apify Reference: [Crunchbase Scraper](https://apify.com/curious_coder/crunchbase-scraper)

**Debank**

- Extract blockchain profiles by address.
- Example: [Debank Profile](https://debank.com/profile/0x5725a458b319d73b8ec84c47de80620e7b191b0c)

---

**What We Offer**

- Competitive pay based on your skills and experience.
- Opportunity to work on impactful projects with potential for long-term collaboration.
- Flexible, remote work arrangement.