Principal Data Engineer
- Company name
- iHerb (website)
- Annual base salary
- $176,534 — $264,801
- Location
Remote from
- Posted on SalaryPine
- Disclaimer
- The meta data above is AI-generated and may be inaccurate. Refer to the job description below for the source of truth.
Job Summary:
The Principal Data Engineer is the leading expert member of the Global Data engineering team and is responsible for designing, developing, and maintaining our infrastructure to support reporting and analytics needs across the company. The engineer will work extensively with other engineers, architects, and analysts to provide insights and drive decision making in the Global Data department. The principal engineer should consistently drive best practices of development and have an excellent understanding of the tools used in iHerb's data platform.
Job Expectations:
- Designs and develops pipelines that support data ingestion, curation, and provisioning of complex enterprise data to support analytics and reporting in our current technology stack.
- Provides successful deployment and provisioning of data solutions to required environments.
- Designs and builds data architecture and applications that successfully enable speed, quality, and efficient pipelines.
- Responsible for the data pipeline continuous integration and continuous delivery (CI/CD) processes.
- Manages data pipeline jobs throughout their lifecycle.
- Assist in the design and build efficient data models for robust business intelligence, analytics, and engineering needs that remain.
- Demonstrate initiative by seeking potential business issues and proactively solve them.
- Analyze and translate business needs into data models to support long-term, scalable, and reliable solutions.
- Interacts with cross-functional customers and development team to gather and define requirements.
- Reviews discrepancies in requirements and resolves with stakeholders in a timely manner.
- Build strong cross-functional partnerships with Data Scientists, Analysts, Product Managers and Software Engineers to understand data needs and deliver on those needs.
- Continuously improves understanding of the data and applications across the business.
- Lead processes that ensure site reliability for our data stack.
- Optimize and tune code performance.
- Develop best practices for standard naming conventions and coding practices to ensure consistency of data models and tracking.
- Actively engages with other technical teams to make recommendations on cohesive infrastructure guidelines.
- Champion the use of the latest innovations.
- Partner with IT and Legal to design secure and automated processes and implement practices that enable data democracy and agility.
- Identifies and recommends appropriate data quality validations and ensures integrations are automated and have proper exception handling.
- Leads pipeline code and metadata framework changes.
- Engages with other development teams upstream to proactively understand downstream impacts
- Actively pursues industry developments and makes suggestions on best practices across the architecture.
- Run, guide, and implement database administration responsibilities and continuously automate relevant processes
- Leads pipeline code and metadata framework changes.
- Seeks out opportunities to elevate fellow engineers’ abilities and experience and mentor them to upgrade their skills.
The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice.
Knowledge, Skills and Abilities:
Required:
- 7+ years of programming skills with Python.
- 3+ years of experience working with API’s.
- Have experience with Docker and/or Kubernetes.
- Proven experience working with large datasets.
- Proficient with shell scripting.
- Proficient in building automated testing within CICD.
- Experienced in Agile methodologies & DevOps approach to maintaining pipelines and databases.
- Excellent knowledge of software engineering fundamentals.
- Deep understanding of data lifecycles, data computation principles, data stores and a solid understanding of CICD principles.
- Proficiency with Databricks (DLT, Medallion Architecture, Lakehouse Concepts, etc)
- Proven experience building scalable data platforms professionally.
- Approves data analysis tools and processes.
- Experience building data pipelines and ETL using PySpark on semi-structured data (merge, delete, combine, wrangling).
- Excellent ability to communicate large-scale projects and their impact on other decisions.
- Experience with large-scale messaging systems like Kafka.
- Have an ability to prioritize workload and handle multiple tasks and at times meet tight deadlines.
- Advanced working SQL experience.
- Comprehensive understanding of data modeling principles and patterns (star and snowflake DM, ER) and a history of implementing them professionally.
- Relational and non-relational data structures, theories, principles, and best practices.
- Knowledge of data privacy regulations (GDPR, CCPA, CRPA) and the impact these regulations have on data engineering framework.
- Data encryption and secure transmission practices (SSL, SSH, SFTP, Certificates, PKI, OAUTH2).
- Has worked on data quality improvement projects such as Master Data Management.
- Strong problem-solving and analytical skills.
- Strong facilitation and consensus building skills. Strong oral and written communication skills; Ability to communicate by simplifying complexity.
- Excellent ability to communicate large-scale projects and their impact on other decisions.
- Ability to understand and apply customer requirements, including drawing out unforeseen implications and making design recommendations.
- Passion for data engineering and for enabling others by making their data easier to access.
- Be proactive, requiring minimal supervision with strong time management or organization skills.
- Proven experience leading large scale projects in an engineering team.
- Must be an inquisitive learner and have a thirst for improvement.
- Ability to mentor Data and Analytics team members in best practices, processes and technologies in Data platforms.
- Excellent verbal and written communication skills.
Equipment Knowledge:
- Databricks Engineer Professional Certification.
- One of the following AWS Certifications, preferred:
- AWS Certified Solutions Architect – Associate/Professional
- AWS Certified Developer– Associate/Professional
- AWS Certified DevOps Engineer – Associate/Professional
- AWS Certified Data Analytics
- AWS Certified Cloud Practitioner
- Experience with Microsoft Office Suite (Word, Excel, PowerPoint)
- Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred
- Experience with technologies such as Python, KAFKA, Airflow and SQL.
Experience Requirements:
Generally, requires a minimum of 10 years as a Data Engineer and at least 5 years as a Data Engineer within a Data and analytics team.
Education Requirements:
Bachelor or master’s degree in computer science, Information Systems, or related fields preferred, or a combination of education and equivalent work experience.
Judgment/Reasoning Ability:
Able to identify, troubleshoot and resolve problems quickly using sound judgment, poise and diplomacy. Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner.
Work Environment:
The noise in the work environment is usually moderate. Other factors are:
- Hectic, fast-paced with multi-level distractions
- Professional, yet casual work environment
- Office / Warehouse environment
- Ability to work extended hours as required
#LI-JC1
The anticipated pay scale for this position can be found below, however the pay range applicable to you may vary by geographic location based on where the job is located or where you work. The final pay offered to a successful candidate will be dependent on several factors that may include but are not limited to the type and years of experience within the job, the type of years and experience within the industry, education, etc. iHerb, LLC is a multi-state employer and this pay scale may not reflect positions that work in other states or locations.
Employees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan. Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies. Employees will enjoy paid holidays throughout the calendar year. Eligibility requirements for these benefits will be controlled by applicable plan documents.
Anticipated Pay Scale:$176,534—$264,801 USD
Staffing Agency Submission Notice
iHerb does not accept unsolicited 3rd party ("Agency") candidates. If you are an Agency, please send any requests to be considered as a supplier in our Vendor Management System to staffingvendors@iherb.com. Do not contact iHerb employees directly. If requested to work on a role, any Agency candidates would be presented through the internal recruiting organization.
About iHerb
iHerb is on a mission to make health and wellness accessible to all. We offer Earth’s best-curated selection of health and wellness products, at the best possible value, delivered with the most convenient experience.
We’re the world’s largest eCommerce platform dedicated to vitamins, minerals, and supplements, and other health and wellness products. For more than 25 years, we’ve been making it simple for people all over the world to purchase the highest quality products. From supplements to skincare to grocery items, we ship over 50,000 products, from over 1,800 brands direct to our customers in 180+ countries.
Our vision is to become the #1 destination for health and wellness across the world.
With a passion for wellness and a mind for innovative solutions, iHerb team members share a vision for a healthier world that drives them each day. Our 5 Shared Values unite our global team:
Focus on the Customer · Empower Our People · Be Entrepreneurial & Pivot Quickly ·
Embrace Diversity & Inclusion · Strive for Simplicity
iHerb Benefits
At iHerb, we are dedicated to offering programs designed to help our employees and their families stay healthy, live well, and plan for their financial future. Built on a strong foundation, our programs provide options and upgrades with flexibility, protection, and security in mind. For the comprehensive benefits list, visit www.iHerbBenefits.com. For our international team members, you may be eligible for benefits depending on the country where you are employed. The Talent Acquisition Partner/local HR representative will go over the benefits you are eligible for.
iHerb is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. iHerb provides equal employment opportunities to all applicants for employment and prohibits discrimination and harassment.