Big Data Engineer

Job description

DESCRIPTION

Are you interested in building intelligence systems from the ground up? Are you interested in working with Big Data Engineers, Applied Scientists, and Software Development Engineers to build large-scale data intelligence systems? Are you interested to work in a team that positively impacts different key pillars of Amazon business such as Pricing, Promotions, Advertising, Auto inventory purchasing, Auto inventory removal, and Inventory placement? Are you interested in working for a team that builds cool systems yet has great work-life balance?

We are seeking a talented Big Data Engineer to join the Profit intelligence team. Profit intelligence system measures true profits and losses for each item shipped to an Amazon customer and predicts profits and losses for future possible shipments. It is all about providing intelligent ways for Amazon to understand profitability across retail business.

In this role you will be part of a team of agile and innovative engineers. You will build data pipelines using big data technologies such as Apache Spark, Hive/Hadoop, and distributed query engines. You should be passionate about working with big data and have the aptitude to incorporate new technologies and evaluate them critically. You should have excellent business and communication skills and be able to work with business owners to develop and define key business questions and build solutions. You are a self-starter, comfortable with ambiguity, and working in a fast-paced and ever-changing environment. Ideally, you are also experienced with at least one of the programming languages such as Java, C++, Scala, etc.

Major Responsibilities:
· Collaborate with PMs, Retail Finance, business customers, and software developers to understand requirements and implement solutions
· Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms with AWS technologies
· Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation
· Keep up to date with big data technologies, evaluate and make decisions around the use of new or existing software products to design the data architecture

Desired profile

BASIC QUALIFICATIONS

· Bachelor’s degree in Computer Science, Electrical Engineering, Information Systems, Mathematics, or a related field
· Ability to work and communicate effectively with developers and Business users
· Experience building large-scale applications and services with big data technologies
· 6+ years of experience in designing and developing analytical systems
· 3+ years of experience in designing and developing data processing pipelines using distributed computing technologies such as Hive, Spark, and etc.
· Strong organizational and multitasking skills with ability to balance competing priorities
· Expertise in SQL, DB Internals, SQL tuning, and ETL development
· Experience with scripting languages such as Python, Perl, etc.
· Proficiency with Linux/Unix systems