Senior Data Engineer

About Us

At RavenPack, we are at the forefront of developing the next generation of generative AI tools for the finance industry and beyond. With 20 years of experience as a leading big data analytics provider for financial services, we empower our clients—including some of the world's most successful hedge funds, banks, and asset managers—to enhance returns, reduce risk, and increase efficiency by integrating public information into their models and workflows. Building on this expertise, we are now launching a new suite of GenAI and SaaS services, designed specifically for financial professionals.

Join a Company that is Powering the Future of Finance with AI

RavenPack has been recognized as the Best Alternative Data Provider by WatersTechnology and has been included in this year’s Top 100 Next Unicorns by Viva Technology. You will be working on Bigdata.com, a next-generation platform aimed at transforming financial decision-making.

About the Role

RavenPack's Bigdata Store is a critical new initiative to revolutionize how we ingest, manage, and index unstructured financial data at scale. We are seeking a Senior Data Engineer to play a pivotal role in building and maintaining this cutting-edge system. As a Senior Data Engineer proficient in Python and Java, you will play a crucial role in designing, implementing, and maintaining robust data pipelines to stream real-time content and manage efficient on-boarding of content archives. You will work closely with cross-functional teams to ensure scalability, reliability, and performance of our systems.

The Bigdata Store is an innovative platform designed to provide seamless access to vast collections of structured and unstructured datasets. These datasets can be directly accessed by the Bigdata AI assistant and through its API, enabling businesses, researchers, and developers to leverage data-driven insights more effectively. The product will cater to business and finance users, by providing relevant and timely data that enhances decision-making processes.

As part of a newly established team based in Madrid, you will work in a focused and independent way to deliver the Bigdata Store. The small team shall comprise developers, product managers and project management professionals. Everyone is expected to be excellent at what they do and be driven towards success. Team leadership is a possibility depending on your interests and background.

The ability to communicate effectively in English both in writing and verbally is a must. Knowledge of Spanish is appreciated but not a business requirement. Only candidates with EU legal working status will be considered.

What Will You Do?

• Design, build, and optimize robust data pipelines to collect, process, and transform large volumes of unstructured data from diverse sources into our new index.




• Collaborate with product managers and stakeholders to understand requirements and translate them into technical solutions.




• Architect and implement serverless architectures for efficient resource utilization and scalability.




• Ensure code quality, performance, and security through code reviews, testing, and best practices.




• Troubleshoot and debug production issues, providing timely resolutions to ensure system reliability.




• Stay updated with emerging technologies and industry trends, recommending and incorporating relevant tools and practices into the development process.

What Must You Have?

• Bachelor's degree in Computer Science, Engineering, or a related field.




• Proven experience as a Software Engineer with expertise in Python and Java using frameworks like SpringBoot, Quarkus or similar.




• Hands-on experience with CI/CD pipelines (e.g., Jenkins, GitLab CI, Travis CI).




• Familiarity with containerization technologies (Docker, Kubernetes).




• Experience with cloud platforms and services (AWS, Azure, GCP).




• Knowledge of serverless architectures and experience with related technologies (AWS Lambda, Azure Functions, Google Cloud Functions).




• Hands-on experience with relational and no-SQL databases.




• Solid understanding of software development best practices, design patterns, and clean code principles.




• Excellent problem-solving skills and attention to detail.




• Strong communication and collaboration abilities.

What Will Be Appreciated?

• Proven track record of building and maintaining production-ready data pipelines using tools like Apache Airflow, Luigi, or similar workflow orchestration frameworks.




• Experience with big data frameworks like Apache Spark, Flink, Kafka or AWS Kinesis.




• Experience working in Agile/Scrum development environments.




• Experience with reactive programming and frameworks like Project Reactor.




• Experience with document-oriented & search databases like Elasticsearch and Vespa.




• Experience with software testing methodologies.

What's In It For You?

• Work in the center of Madrid, a cosmopolitan city and the center of cultural activity in Spain.




• Growth Opportunity: Join a team building AI that truly matters, contributing to making Gen-AI useful for finance and business research in a rapidly growing company with 180+ team members across offices in Marbella and New York.




• You will have ownership of projects working in a collaborative environment where we will value your contribution.




• You will work in an agile environment able to react quickly to changes with a fairly flat hierarchy.




• As we encourage continuous learning, we will support your ongoing training.




• Diversity is in our DNA! You will work in an international environment (over 29 nationalities and 24 languages spoken!)

We are an equal-opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.