Senior Data Acquisition Engineer at JoomPulse

JoomPulse is an AI analytics tool for Mercado Livre and Shopee sellers, providing insights into the most profitable products and fastest-growing categories — helping sellers boost their profits with data-driven decisions. JoomPulse is one of the key businesses of Joom Group, an international tech-centric group of e-commerce companies that was founded in 2016 in Latvia. Joom Group also includes the following businesses: Joom, a global cross-border marketplace; JoomPro, the first and only end-to-end cross-border B2B marketplace; and Onfy, a pharmaceutical marketplace in Germany. Joom Group has offices in Latvia, China, Germany, and Brazil, with its headquarters in Lisbon, Portugal. We work as one international team, sharing knowledge and collaborating across countries, businesses and products. We are looking for an experienced Senior Data Acquisition Engineer who will own the data acquisition pipelines behind JoomPulse analytics. Marketplaces keep raising their anti-bot defences, so this is a role about solving problems that have no ready answers yet — hands-on, experimental, and with full freedom in tooling. Responsibilities Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee Build and maintain distributed crawlers running in production Monitor target marketplaces for changes, detect them early and update bypass logic proactively Reverse engineer private APIs to get data faster and more reliably than through HTML Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions Investigate pipeline failures caused by new anti-bot checks and restore the data flow Use LLMs and any other tooling to research and solve problems that have no ready answers Spot data that can be useful for the product and bring these insights to the team Requirements 3+ years of building distributed crawlers running in production Strong Python (Scrapy / Playwright) or Node.js (Puppeteer / Crawlee) Behavioral simulation: human-like mouse trajectories, realistic timing, scroll and click patterns, bypassing behavioral biometrics Security research mindset: monitoring target sites for changes, change detection, proactive updates of bypass logic Experience with proxy infrastructure: residential, mobile, ISP, and rotating proxies Reverse engineering of private APIs via mitmproxy, Charles, or Burp Scaling crawlers on distributed queues: Redis, Kafka or SQS Active use of LLMs and an experimental mindset — you try every available tool until the result is there Proactivity: you notice useful data and bring it yourself, without a detailed specification English sufficient for daily work in an international team Preferred Direct experience with Mercado Livre, Amazon, Shopee or TikTok Shop Public GitHub: marketplace crawlers, or contributions to Scrapy, Playwright, curl-impersonate, undetected-chromedriver Experience with anti-detect browsers and stealth tooling: Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, tls-client Experience running a project end-to-end or managing other engineers Benefits Compensation package: base salary and performance-based bonuses Office-first: flexible hours with the possibility to work remotely 52 days per year, and 22 days of paid annual leave Care & Wellbeing: health insurance (including dental care) for employees and their children, daily meal allowance, and 100% paid sick leave AI-first approach: licenses and access to a wide range of AI tools Team & Growth: collaboration with colleagues across Portugal, Brazil, Latvia and China, with opportunities for promotions, professional training, and English courses Community & Engagement: annual team-building activities, knowledge-sharing workshops, and a strong sense of teamwork Before applying for the above position, please review our Candidate Privacy Notice here: https://legal.joom.com/recruitment/Joom_Unipessoal_LDA_Job_Applicant_Privacy_Notice.pdf By responding to the vacancy, you acknowledge that you have read our Privacy Notice.