Hewlett Packard Enterprise Company Big Data ETL Engineer in Tlaquepaque, Mexico
Big Data ETL Engineer
At Hewlett Packard Enterprise (HPE), we live by three core values that drive our business: Partner. Innovate. Act. These values combine to help us create important work all over the world to advance how people live and work.
Big Data ETL Engineer
The Big Data engineer is responsible for developing ETL and streaming integration data flows from various internal systems and databases and external partner systems. Data integration workflows are either scheduled workflows that drive automated processes or continuously running streaming jobs that respond to events in the system.
Design ETL data flows, develops and implement data querying, cleansing, and transformation programs in Pig, Hive and Spark.
Integrate Flume, Kafka, Spark to create continuous big data pipelines for digital apps.
Implement data integration workflows using tools like Talend, Pentaho, and DataIku.
Apply analytical and problem solving skills to new requirements..
Develop rapid prototypes to try out new designs patterns and technologies.
Test data integration workflows in DEV and QA systems and support move to production.
Execute and write portions of testing plans, protocols, Document code for assigned portion of application; identify and debug issues with code and suggests changes or improvements.
Communicate with business, product, and development teams during development, testing, and production support.
Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent.
Minimum 3 to 5 years of experience.
Experience and skills
Hands on Experience developing Hadoop integrations for data ingestion, data mapping and data processing capabilities using Pig, Hive, Hbase, Sqoop, and Oozie .
Knowledge of Flume, Storm, Kafka, Spark is a plus.
Good understanding of programming fundamentals, asynchronous/synchronous programming concepts and design patterns.
3+ years of software development experience with 2+ years in Agile / Scrum environment.
Can-do attitude and energy to the team.
Self-starter with natural ability to balance priorities and work in a lean and agile environment .
Must have proven track record building production software on Hadoop.
Expertise in SQL, database creation, updates, querying.
Core java fundamentals, strong computer science fundamentals.
Software systems testing methodology, including execution of test plans, debugging, and testing scripts and tools.
Strong written and verbal communication skills; mastery in English and local language. Ability to effectively communicate design proposals and negotiate options.
Hadoop Developer certification.
Experience implementing Lambda architecture.
NoSQL Databases - Cassandra, MongoDB.
Python scripting experience.
Experience in Enterprise IT environments.
Hewlett Packard Enterprise is EEO F/M/Protected Veteran/ Individual with Disabilities.
HPE will comply with all applicable laws related to the use of arrest and conviction records, including the San Francisco Fair Chance Ordinance and similar laws and will consider for employment qualified applicants with criminal histories.
Hewlett Packard Enterprise
Technology innovation that fosters business transformation.
We Are In the Acceleration Business
We help customers use technology to slash the time it takes to turn ideas into value. In turn, they transform industries, markets and lives.
Some of our customers run traditional IT environments. Most are transitioning to a secure, cloud-enabled, mobile-friendly infrastructure. Many rely on a combination of both. Wherever they are in that journey, we provide the technology and solutions to help them succeed.
Standards of business conduct (SBC):
The Hewlett Packard Enterprise Standards of Business Conduct (SBC) embody the fundamental principles that govern our ethical and legal obligations to Hewlett Packard Enterprise. They pertain not only to our conduct within the company but also to conduct involving our customers, channel partners, suppliers and competitors.
Read more about how we win the right way.
Equal Opportunity Employer (EEO):
Hewlett Packard Enterprise provides equal employment opportunity to any employee or applicant without regard to sex, gender, color, race, ethnicity, religion, creed, national origin, ancestry, citizenship, age, marital status, sexual orientation, gender identity and expression, physical or mental disability, medical condition, pregnancy, protected veteran status, uniformed service status, familial status, genetic information, political affiliation, or any other characteristic protected by federal, state, or local law.
Please click here: Equal Employment Opportunity.
If you’d like more information about your EEO right as an applicant under the law, please click here: Equal Employment Opportunity is the Law
Equal Employment Opportunity is the Law - Supplement
Hewlett Packard Enterprise is committed to working with and providing reasonable accommodation to qualified individuals with physical and mental disabilities. If you need assistance in filling out the employment application or require a reasonable accommodation while seeking employment, please e-mail email@example.com.
Note: This option is reserved for applicants needing a reasonable accommodation related to a disability.