Recent Graduate Crawler R&D Engineer
Lighthouse
At Lighthouse, we’re on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential.
Backed by $370 million in series C funding and driven by an unwavering passion for growth, we’ve welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 700+ teammates span 35 countries and represent 34 nationalities.
At Lighthouse, we’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship? 🚀
What you will do
As a Recent Graduate Crawler R&D engineer, you will work on our crawler backend to ensure we can collect the content we require in a reliable and timely manner.
Where you will have impact
You will work on several innovative projects on the R&D side of our crawler infrastructure, some of the projects we’re currently working on include:
- Our automated browser solution that allows for more advanced scraping and taking desktop and mobile web screenshots, written in Typescript.
- Our man-in-the-middle proxy, responsible for (among others) monitoring and routing of all our crawler traffic. This project involves a more advanced use of the Rust programming language.
- Our solution to take mobile app screenshots, written in Python.
You will also get involved in general crawler pipeline infrastructure projects.
Technologies you will work with
Google Cloud, Kubernetes, Rust, NodeJS, TypeScript, Scrapy, Python, Prometheus, Grafana (feel free to ask us why these are the best fit for us)
About our team
Our team is at the helm of our sophisticated data extraction infrastructure. Tasked with the responsibility of acquiring pricing data from over 200 unique data sources, we process nearly 200 million requests each day. The data we collect is the lifeblood of our products. We are committed to ensuring its reliable and timely delivery, thereby powering our diverse product portfolio.
What's in it for you?
- Flexible working environment: Work from home or at one of our global offices.
- Flexible time off: Autonomy to manage your work-life balance.
- Collaborative team: High-bar, friendly, creative, and passionate colleagues.
- Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
- Impactful work: Shape products relied on by 85,000+ users worldwide.
- Comprehensive health insurance: Extensive coverage for you and your dependents.
- Private pension funding: Group insurance to secure your future.
- Competitive compensation: Proactively maintained to value your work.
- Referral bonuses: Earn rewards for bringing in new talent.
Who you are
- Fluent in English
- You have a passion for tinkering with web and/or mobile applications
- You are eager to expand your knowledge on browsers, reverse engineering, networking, and cloud infrastructure
- You have experience with Python
- Experience with Typescript and/or Rust is a plus. We are happy to provide you with L&D opportunities in this area.
Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is not just a policy; it's part of our culture.
If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply.
We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry.