- If you have experience with Spark and Kafka,
- If you have experience with HDFS/Hive and generally with Hadoop,
- If you have advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases,
- If you have great development skills in Scala, Python or Java,
- If you hav 5+ years of experience in a Data and/or Software Engineer role.
- Experience with Nifi and groovy based processors,
- Spring/springboot based microservices creation,
- Bash and/or Ansible knowledge,
- Experience in the financial services area.
- Experience with stream-processing using Flink or Kafka,
- Experience in building and optimizing big scale data pipelines, architectures and data sets - in both batch and real-time data integration,
- Working knowledge of message queuing, stream processing, and highly scalable BigData data stores,
- Experience working in a DevOps environment - CI/CD, Azure DevOps, Test automation, Dockereld.
We are the biggest datalake in ING. Besides batch ingestion we do support near real-time data ingestion and distribution using Kafka. We plan to move to a new streaming ingest platform, using container technologies and focus more on being an event based datalake. We have build a generic, metadata driven, data pipeline on top of Nifi. You will be joining a team of experts, where you can learn, share and will have fun.
- contract of employment
type of contract
- 9:00 - 17:00
- Zajęcza 15, Warszawa
this is the location of our office
- professional development
- certificates and knowledge development
- training budget
- access to the newest technologies
- international projects
- free English courses
- provate medical care
- 50% funded Multisport Card
- bicycle parking
- chillout rooms
- integration events and Stay Fit program
- stability of employement
- fully equipped workstations