Senior Data Engineer

Job Description:

Vertex Inc is looking for a Senior/Lead Data Engineer for its Data Fabric team.

In this role, you will work to increase the domain data coverage and adoption of the Data Platform by promoting a connected user experience through data.

You will increase data literacy and trust by leading our Data Governance and Master Data Management initiatives.

You will contribute to the vision and roadmap of self-serve capabilities through the Vertex Data Platform.

This senior engineer develops data pipelines extracting and transforming data as governed assets into the data platform, improves system quality by identifying issues and common patterns and developing standard operating procedures; and enhances applications by identifying opportunities for improvement, making recommendations, and designing and implementing systems.

ESSENTIAL JOB FUNCTIONS AND RESPONSIBILITIES:


* Implement, test, maintain and support software, based on technical design specifications.


* Prepare technical design specifications based on functional requirements and analysis documents.


* Apply professional concepts, experience and company objectives in order to perform an in-depth analysis of situations or data to resolve complex issues in creative ways.


* Review functional requirements, analysis, and design documents and provide feedback.


* Assist customer support with technical problems and questions.


* Work without supervision, working with wide latitude for independent decision making.


* Lead the work of others in the context of a project.


* Mentor less experienced developers and team members.


* Network with key contacts outside own area of expertise.


* Investigate software development tools.


* Perform special assignments.


* Participate in architecture and code reviews.


* Lead or participate in other projects or duties.


* Must be results oriented, customer focused, and exhibit good interpersonal skills.


* Must possess strong interpersonal, organizational, presentation and facilitation skills.


* Occasional travel required.

(Up to 5%)


* Participate in other projects or duties.

SUPERVISORY RESPONSIBILITIES:


* N/A

KNOWLEDGE, SKILLS AND ABILITIES:


* Ability and willingness to learn new technologies and apply them at work to stay ahead of the curve.


* Expertise in building and managing large volume data processing (both streaming and batch) platform is a must.


* Expertise in SQL and Python.


* Expertise in OLAP databases such as Snowflake or Redshift.


* Expertise in distributed data processing frameworks such as Apache Spark, Flink or similar.


* Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar


* Expertise in SQL and No-SQL databases - Apache Cassandra, DynamoDB, MySQL, PostgreSQL


* Expert with CI/CD pipelines, preferably GitHub Actions Workflows.


* Cloud (AWS) experience is preferred and Infrastructure ...