Data Engineer
Integrity, knowledge, imagination, skill, diversity and teamwork, do you hold them all? Do you have ideas and ideas? Are you a great advisor and a coordinator? Are you a versatile self-starter who can adapt quickly to new environments? Then, Apply Now!
Working with one of the top financial clients this role calls for a Data Engineer who will review, analyze, and modify programming systems including encoding, testing, debugging and documenting programs. The successful candidate must be familiar with a variety of the field's concepts, practices, and procedures. Relies on experience and judgment to plan and accomplish goals. This candidate will perform a variety of complicated tasks and may lead and direct the work of others.
Responsibilities:
- Responsible for leading technical aspects of the project from inception through to deployment.
- Ensure that solutions adhere to development best practices and architectural principles.
- Apply analytical skills to resolve problems and deliver viable solutions. Anticipate obstacles and execute proactive approaches to issues.
- Active participation in issue resolution.
- Provide detailed development estimates to the Project Manager for development efforts as well as weekly status reporting and budget forecasting.
- Configuration management for the sub-projects within the release.
- Responsible for coding, testing, packaging, deployment, and support of builds as code is promoted from development, system, acceptance, and production environments. May lead code reviews.
- Participate in the development of test strategy, test plans, test cases and testing efforts (unit testing and integration testing of code).
- Provide technical support to business and testing teams during testing phases. Track defects, defect triage and resolution.
- Data set up and environment shakedown. Coaching/mentoring of junior developers. Knowledge transfer within the group.
- Ensure required documentation is housed in the project repository and that knowledge transfer has occurred to full-time staff upon completion of the contract term.
Desired Skill Set:
- 10 years of experience as a Data Engineer
- 10 years of proficiency in SQL and experience with relational and NoSQL databases
- 10 years of strong understanding of data warehousing concepts and ETL processes
- 7 years of solid understanding of data communication protocols like REST and GRPC
- 7 years of experience in maintaining a real-time data processing solution built on Scala, Spark and Akka framework
- 7 years of experience with the Akka framework for building distributed systems
- 7 years of experience with big data technologies such as Hadoop, Kafka, Hive and HBase
Nice To Have:
- Exposure to Capital Markets
- Experience with CI/CD pipelines and infrastructure as code (IaaC)
- Experience with cloud data platforms like Azure ADLS, Google Big Query and Databricks, Dremio
- Experience with Python
- Experience with real-time analytics and event-driven architectures
- Familiarity with machine learning and data science workflows
- Proficiency with C# for Excel add-ins
BeachHead is an equal opportunity agency and employer. We advocate for you and welcome anyone regardless of race, color, religion, national origin, sex, physical or mental disability, or age.
Privacy Policy