MNC InsiderMNC Insider

LLM Engineer

Booz Allen Hamilton

LLM Engineer

full-timePosted: Aug 5, 2026Updated: Sep 2, 2026Okinawa

Job Description

LLM EngineerThe Opportunity:Support the development, integration, and sustainment of AI-enabled workflows and knowledge management solutions supporting a federal client. Collaborate with technical and functional stakeholders to develop document ingestion pipelines, retrieval workflows, and LLM-enabled capabilities that improve information discovery and decision support. Design and implement processes for metadata extraction, semantic chunking, relationship extraction, and structured knowledge generation across multiple data sources and document types. Develop, test, and refine prompt engineering, retrieval, and orchestration workflows to support rapid prototyping efforts. Integrate AI-enabled solutions with cloud-based services, databases, and enterprise applications. Support the evaluation and implementation of emerging AI technologies and contribute to the expansion of new use cases across the platform.You Have2+ years of experience developing software applications using PythonExperience developing AI-enabled applications using Large Language Models (LLMs), retrieval-augmented generation (RAG), or prompt engineeringExperience working within Agile software development environments.Ability to obtain a Secret clearanceBachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, Computer Engineering, or Information SystemsNice If You HaveExperience developing data ingestion, transformation, or processing pipelines, and working with structured and unstructured data sourcesExperience implementing semantic chunking strategies for large document collectionsExperience extracting metadata, entities, relationships, or knowledge graphs from unstructured documentsExperience using vector databases, such as OpenSearch, Pinecone, Weaviate, Chroma, or FAISS, semantic search technologies, or embedding modelsExperience with LangChain, LangGraph, LlamaIndex, CrewAI, Semantic Kernel, or similar AI orchestration frameworksExperience with AWS services supporting AI, analytics, and data processing workloads, and developing AI-enabled knowledge management, search, automation, or decision-support solutionsExperience with OCR, document processing, and multi-format document ingestion pipelinesExperience evaluating, benchmarking, and optimizing LLM performance, and working with graph databases, knowledge graphs, ontology-driven systems, or relationship extraction frameworksExperience supporting rapid prototyping efforts and transitioning prototypes into production-ready solutionsExperience supporting Department of Defense or federal clientsClearance:Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.CompensationAt Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $99,000.00 to $225,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.Identity StatementAs part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided. Work ModelOur people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.Commitment to Non-DiscriminationAll qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

Locations

  • Okinawa

Skills Required

  • vector databasesintermediate
  • LangChainintermediate
  • AWS services supporting AIintermediate
  • OCRintermediate

Required Qualifications

  • 2+ years of experience developing software applications using Python (experience, 2 years)
  • Experience developing AI-enabled applications using Large Language Models (LLMs), retrieval-augmented generation (RAG), or prompt engineering (experience)
  • Experience working within Agile software development environments. (experience)
  • Ability to obtain a Secret clearance (experience)
  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, Computer Engineering, or Information Systems (degree in computer science)
  • 2+ years of experience developing software applications using Python (experience, 2 years)
  • Experience developing AI-enabled applications using Large Language Models (LLMs), retrieval-augmented generation (RAG), or prompt engineering (experience)
  • Experience working within Agile software development environments. (experience)
  • Ability to obtain a Secret clearance (experience)
  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, Computer Engineering, or Information Systems (degree in computer science)
  • Experience developing data ingestion, transformation, or processing pipelines, and working with structured and unstructured data sources (experience)
  • Experience implementing semantic chunking strategies for large document collections (experience)
  • Experience extracting metadata, entities, relationships, or knowledge graphs from unstructured documents (experience)
  • Experience using vector databases, such as OpenSearch, Pinecone, Weaviate, Chroma, or FAISS, semantic search technologies, or embedding models (experience)
  • Experience with LangChain, LangGraph, LlamaIndex, CrewAI, Semantic Kernel, or similar AI orchestration frameworks (experience)
  • Experience with AWS services supporting AI, analytics, and data processing workloads, and developing AI-enabled knowledge management, search, automation, or decision-support solutions (experience)
  • Experience with OCR, document processing, and multi-format document ingestion pipelines (experience)
  • Experience evaluating, benchmarking, and optimizing LLM performance, and working with graph databases, knowledge graphs, ontology-driven systems, or relationship extraction frameworks (experience)
  • Experience supporting rapid prototyping efforts and transitioning prototypes into production-ready solutions (experience)
  • Experience supporting Department of Defense or federal clients (experience)
  • Experience developing data ingestion, transformation, or processing pipelines, and working with structured and unstructured data sources (experience)
  • Experience implementing semantic chunking strategies for large document collections (experience)
  • Experience extracting metadata, entities, relationships, or knowledge graphs from unstructured documents (experience)
  • Experience using vector databases, such as OpenSearch, Pinecone, Weaviate, Chroma, or FAISS, semantic search technologies, or embedding models (experience)
  • Experience with LangChain, LangGraph, LlamaIndex, CrewAI, Semantic Kernel, or similar AI orchestration frameworks (experience)
  • Experience with AWS services supporting AI, analytics, and data processing workloads, and developing AI-enabled knowledge management, search, automation, or decision-support solutions (experience)
  • Experience with OCR, document processing, and multi-format document ingestion pipelines (experience)
  • Experience evaluating, benchmarking, and optimizing LLM performance, and working with graph databases, knowledge graphs, ontology-driven systems, or relationship extraction frameworks (experience)
  • Experience supporting rapid prototyping efforts and transitioning prototypes into production-ready solutions (experience)
  • Experience supporting Department of Defense or federal clients (experience)

Target Your Resume for "LLM Engineer" , Booz Allen Hamilton

Get personalized recommendations to optimize your resume specifically for LLM Engineer. Takes only 15 seconds!

AI-powered keyword optimization
Skills matching & gap analysis
Experience alignment suggestions

Check Your ATS Score for "LLM Engineer" , Booz Allen Hamilton

Find out how well your resume matches this job's requirements. Get comprehensive analysis including ATS compatibility, keyword matching, skill gaps, and personalized recommendations.

ATS compatibility check
Keyword optimization analysis
Skill matching & gap identification
Format & readability score

Tags & Categories

GeneralGeneral

Answer 10 quick questions to check your fit for LLM Engineer @ Booz Allen Hamilton.

Quiz Challenge
10 Questions
~2 Minutes
Instant Score

Related Books and Jobs

No related jobs found at the moment.