Generative AI Platform Engineer
- Company name
- Accenture Federal Services (website)
- Annual base salary
- $100,200 — $203,400
- Location
On-site from
- Posted on SalaryPine
Build AI that matters. At Accenture Federal Services (AFS), we turn GenAI from demos into operational capabilities that millions rely on. We ship production GenAI apps for confidential federal programs across defense, national security, public safety, civilian, and military health where reliability, privacy, and safety aren’t optional.
AFS is a technology company within global Accenture and a Glassdoor Top 100 Best Place to Work. You’ll join a collaborative, caring community that invests in your growth through hands‐on experience, certifications, and industry training. We ship in weeks, not quarters, and measure success by latency, reliability, safety, and cost.
Confidentiality matters: We don’t disclose program details on public postings. If you advance, we’ll share specifics as appropriate during the process.
Role Overview
- Operationalize LLM/RAG: Stand up and harden AI services (cloud or on‐prem) that ground responses in mission data with low hallucination rates.
- Guardrails & governance: Implement prompt/version management, policy‐based filtering, role‐based access, audit trails, and safety checks aligned to federal guidelines.
- Observability & SRE for AI: Define SLIs/SLOs (quality, latency, safety, cost), instrument metrics, run on‐call, lead postmortems, and reduce MTTR.
- Performance & cost engineering: Optimize p95 latency with caching/batching/autoscaling; meter usage and apply FinOps to keep token/spend within targets.
- Reusable platform components: Ship SDKs, CI/CD templates, and Terraform/IaC modules that accelerate multiple mission teams not one‐off projects.
- Applied theory (where it matters): Use IR metrics (e.g., NDCG) to improve retrieval quality; apply queueing/control principles to hit latency SLOs; run offline/online evals for helpfulness, safety, and factuality.
What you won’t do: Train or invent new foundation models; deliver academic research. Your focus is making best‐in‐class models work flawlessly in production.
You’ll Thrive Here If You
- Own production systems end‐to‐end: Integration → deployment → observability → incident response.
- Are strong in Python
- Have experience with retrieval/vector search (e.g., pgvector/Milvus/OpenSearch) and grounding AI in enterprise data.
- Think in SLOs and dashboards; you improve reliability, latency, safety, and cost with data.
- Communicate clearly with engineers, PMs, and security stakeholders especially in compliance‐heavy environments.
- Must be a US Citizen
Nice to Have
- Experience integrating leading cloud AI services or on‐prem inference stacks Background in evaluation/safety testing or A/B experimentation for AI experiences.
- FinOps for AI: metering, budgets, and optimization strategies for usage and spend.
- Prior work in regulated/secure environments (e.g., FedRAMP‐like controls, ATO processes) with fast shipping.
- Contributions to internal frameworks or open‐source tooling; mentorship of engineers.
- Advanced degree welcome but not required high‐impact delivery matters most.
As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Washington, Vermont, the District of Columbia, and the city of Cleveland. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.
The pay range for the states of California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Washington, Vermont, the District of Columbia, and the city of Cleveland is:$100,200—$203,400 USD