Data Engineer

Role Overview

ExpertLogix advises, architects, selects, and implements solutions for clients so that they may efficiently run their businesses, with a focus on data analytics in the Cloud. These service areas span IoT, Solution Architecture, data engineering, analytics, AI, ML, and DevOps.

We are looking for a savvy Senior Cloud Engineer for platforms to join our growing ExpertLogix team of data professionals. The hire will be responsible for optimized data pipelines. The ideal candidate is an experienced technologist who has intimate knowledge on platforms both cloud on and on-premises. The candidate will support our clients, software engineers, developers, data architects, data analysts, and data scientists on data initiatives and will ensure optimal architecture usage. The candidate must be a quick learner, self-directed and comfortable supporting the platform needs of multiple teams, systems, and products.

The role will encompass the use of a broad range of cloud technologies, operating systems (Windows, Linux), and Hadoop application environments with an emphasis on the implementation of best practice cloud security principles.

  • Implementation and ongoing administration of cloud environments and possible private and public cloud Big Data (Hadoop, etc.) implementations
  • Design, deploy, automate, maintain, and manage cloud-based or on-prem production systems, to ensure the availability, performance, scalability, and security of production systems
  • Work as part of an operational team and participate in and provide expertise to development teams to troubleshoot known issues
  • Monitor, troubleshoot, and escalate cluster issues using a variety of open source and proprietary toolsets.
  • Operationalize Cloud environments and/or Hadoop implementations from the following perspectives:
    • Service Delivery: Includes environmental provisioning, maintaining service level agreements, and regulatory compliance
    • Service Operations: Includes monitoring, orchestration and automation, auditing, access management, incident management, metering and chargeback, cost management, and optimization
    • Governance, Risk, and Compliance: Integrated approach to enterprise security to manage information risk and implement controls needed for governance, risk, and compliance
  • Perform operating system, service level, and application updates, patches for Hadoop Environments
  • Evaluate and propose new tools and technologies to meet the needs of the organization
  • Align architecture with business requirements
  • Suggest architecture improvements, recommending process improvements
  • System troubleshooting and problem-solving across cloud platforms and application domains
  • Ensuring critical system security is using best fit for purpose security solutions

Other responsibilities: ​

  • Good problem-solving skills, including providing simple solutions to complex situations
  • Must be a strong team player with the ability to communicate and collaborate effectively in a geographically disperse working environment
  • Must be an excellent communicator in terms of status and raising issues that might impact projects to either project or account management
  • While not engaged, work on internal projects and learning exercises to:
    • Extend your technical knowledge and skills by working with standard stack and new tools
    • Work on internal tech aimed to help build new technical practices and accelerators
  • Participation is encouraged to assigned training and obtain certifications as identified by the ITT department and/or ExpertLogix Professional Growth Manager

Soft Skills Required:

  • High level of personal initiative and energy
  • Excellent verbal and written communication skills
  • Capable of working autonomously with minimal oversight
  • Willing to raise issues to ExpertLogix or client management as required, clearly defining the issue and potential solutions
  • Common sense approach to problems
  • Capable of adapting written processes when required and capturing improvements to the process for later review

Technical Skill Sets (Mandatory):

  • Advanced knowledge and experience with at least one of the Cloud platforms (AWS, Azure or GCP)
  • Intermediate experience with creating, optimizing, and administering platforms (Cloud or on-premises)
  • Experience with Docker containers, including containerizing services and deploying containers in a cloud environment (ie. Kubernetes)
  • DevOps experience, ie. (Git + CI/CD + IaC)
  • IaC experience with Terraform/Ansible/CloudFormation (1+ Years)
  • Experience developing solutions with Python (2+ Years)
  • Ability to gather and track requirements
  • Knowledge and experience with Unix and/or Windows administration (1+ year)

Knowledge of the following would be an asset:

  • Experience with configuring and managing cloud data warehouses – Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered
  • Intermediate Agile methodology knowledge

Travel Expectations:

When work returns to normal (post-Covid) the Candidates must be available to travel up to two weeks per month regularly, with occasional periods of 2 to 3 weeks per month based on specific client requirements if needed

Apply for this position

Allowed Type(s): .pdf, .doc, .docx