Data Engineer
Vancouver
Full Time
What We Are About
At Fastloop, we have a deep passion for helping businesses build for the future.
This comes to life based on our adoption of leading technologies and best-in class business expertise within our three core pillars of excellence: Big Data, Cloud Technology and Advanced Analytics.
We are not your typical consultants. We are business operators and technology experts who understand how businesses work from the inside.
Fastloopers are problem solvers and like to roll up their sleeves and get in the trenches with our customers. We genuinely enjoy helping organizations make sense of their data and their infrastructure, so they can realize new competitive advantages and accelerate their digital transformation journeys.
Fastloop is based in Vancouver, Canada, but provides a flexible and hybrid working environment to candidates across North America.
About the Opportunity
As a Fastloop Data Engineer you will play a critical role in helping clients automate real-time and batched data ingestion pipelines, analytics, and best in-class data warehouse/data lake practices. This will involve designing, planning, and implementing enterprise grade data solutions that will help client businesses meet their strategic goals and objectives on customer data, corporate performance, operational visibility, and data monetization. You will work with a highly skilled team of cross-functional team members across the business, cloud, advanced analytics, and other digital solutions, in order to problem solve and solution for leading edge data challenges and opportunities.
Responsibilities
- Designing and implementing data ingestion pipelines that will feed into the data warehouse and/or data lake in batch or real-time streaming processes
- Identifying, designing, and implementing internal process improvements that will involve: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability;
- Delivering testing, monitoring, debugging planning, and creating technical documents as a part of the data lifecycle and development process;
- Implementing, operating, and optimizing CI/CD pipelines for the effective delivery of web and cloud-based applications;
- Installing and monitoring cloud-based services for high availability, performance, reliability, security, efficiency, and the ability to meet client technical requirements and service level agreements;
- Monitoring of data related performance, troubleshooting and resolving of errors;
- Documenting standards and best practices around key data processes and architecture; and
- Providing feedback to the team about new or emerging client data needs while also demonstrating an understanding of Fastloop’s key competitive positioning and value offering for clients.
What You’ll Need to Succeed
Must-Have
- 3 + years of relevant experience in data engineering, data ingestion, and/or data warehousing
- 2+ years of experience in a software engineering environment;
- Demonstrated experience in one or more big data cloud technologies (GCP/Azure/AWS);
- Experience with DevOps and CI/CD pipeline in a production environment;
- Demonstrated working experience implementing cloud monitoring strategies;
- Proficiency with agile or lean development practices;
- Analytical and problem-solving skills, and the ability to handle complex issues;
- A degree or technical diploma in Computer Science/Engineering or related field;
- Experience with SQL and NoSQL systems;
- Proficiency in some of the following languages: Scala, Java, Python, Bash;
- Experience with automated testing systems;
- Knowledge of data modelling, data warehousing, ETL processes, and business intelligence reporting tools;
- Experience working with CI/CD, containerization, and virtualization tools such as Gitlab, Jenkins, Kubernetes, Docker; and
- Experience with data modeling and design with BI platforms, including Power BI, Qlik, and/or Looker
Ready to join the team?
