AI LLM Technology Principal Architect (All Genders)

Accenture
Stuttgart

AI Large Language Model (LLM) Technology ArchitectYOU AREAs an experienced AI/LLM Architect, you will be at the heart of designing and building advanced AI systems that power the modern enterprise. A critical dimension of this role is owning the design of a comprehensive AI context layer — drawing on enterprise knowledge bases, structured and unstructured data sources, and domain-specific content — to ground AI systems in the realities of each client's business and ensure outputs are accurate, trustworthy, and impactful. As the technical authority on your domains, you will lead architecture decisions and be accountable for ensuring systems meet rigorous non-functional requirements across security, observability, governance, performance, and scalability. You will produce and own the architecture artifacts that shape delivery — including architecture decision records (ADRs), component and data flow diagrams, and integration specifications — and provide the technical leadership that enables cross-functional teams of data engineers, ML engineers, and application developers to execute with clarity and confidence. Your contributions will be instrumental in shaping how clients adopt and scale AI, pushing the boundaries of what these systems can achieve and delivering measurable, lasting business value.THE WORKTranslate business strategy into a technical vision by defining the non-functional requirements (NFRs) necessary to meet operational goals for performance, reliability, and cost. Lead stakeholder workshops to align on technical feasibility, define project scope, and manage expectations with clients and leadership. Drive the technology selection process, evaluating build-vs-buy decisions for AI platforms (e.g., Arize, LangSmith) and foundational models.Architect model- and tool-agnostic multi-agent systems governed by an MCP Control Plane.Design and implement the Agent Registry as the mandatory system of record and the AI Gateway for runtime policy enforcement. Design and implement a certification gate to ensure no uncertified agents enter production, validating identity, policies, and evaluation metrics.Design, implement, and abstract core agent services, including a first-class abstracted memory service with semantic, episodic, and procedural endpoints.Architect the end-to-end data pipeline for AI systems, including data ingestion, preprocessing, and synchronization for fine-tuning and RAG.Design and implement the context layer—spanning knowledge graphs, vector search, and semantic retrieval—to create reliable, grounded RAG pipelines.Architect foundation model adaptation strategies, including dynamic, cost-and-performance-aware model routing and selection.Design, implement, and prototype high-throughput, low-latency inferencing solutions using techniques like response caching and request batching.Define security, governance, and observability as centrally-enforced, by-design controls for all AI systems.Architect a robust, defense-in-depth security framework, including per-agent identity with IAM/IAP binding and layered guardrails.Design and implement FinOps controls enforced at the AI Gateway, including token budgets, cost-center labeling, and threshold alerts. Establish the framework for comprehensive system evaluation, adopting productized tools and instrumenting observability with OTel Define and maintain the enterprise-wide AI reference architecture, reusable design patterns, and a library of approved software components.Independently design, implement, build, and deliver proof-of-concept prototypes and foundational software components to validate architectural decisions.Produce and own authoritative architecture artifacts, including blueprints, sequence diagrams, design specifications, and Architectural Decision Records (ADRs).Mentor and guide cross-functional engineering teams (data, ML, application) on architectural best practices and design patterns.Continuously research and integrate emerging AI patterns, frameworks, and technologies to maintain a forward-looking architecture. EDUCATIONBachelor's Degree or equivalent BASIC (REQUIRED) QUALIFICATIONSignificant experience in designing & deploying enterprise grade advanced ai solutions using agentic, generative and classical AI/ML using at least one cloud vendor. Practical experience in the Agentic, LLM and Generative AI space. Well versed in coding using python Solid foundation in architecting and operationalizing LLM driven application architecture patterns. Professional working experience in coding engineering, machine learning, deep learning and NLP solutions and applications. Several years of hands on experience as a machine learning architect in the industry designing big data, machine learning. large scale analytical engineering solutions. German on B2 level minimum.

Veröffentlicht am 2026-11-14

Empfohlene Jobs

Cloud DevOps Engineer (all genders)

adesso
Stuttgart

DEINE ROLLE Cloud-Lösungen: Du entwickelst und implementierst dynamisch skalierbare, fehlertolerante und sichere Cloud-Lösungen mit Fokus auf Automatisierung. Technologien: Du setzt Cloud-nat…

Details Anzeigen
Veröffentlicht am 2026-11-05

SAP ABAP Entwickler mit Kenntnissen in einem der SAP Logistik Module PP/WM/EWM/SD/MM/PM/QM

KA Resources
Stuttgart

Für meinen Kunden, ein innovativer Softwarehersteller, der plattformübergreifende Business Apps, ERP-Integrationen und mobile Datenerfassung anbietet, suche ich einen SAP ABAP-Entwickler für die St…

Details Anzeigen
Veröffentlicht am 2026-11-07

Senior Consultant / Manager Enterprise Architecture & Cloud Transformation Energiewirtschaft (m/w/d)

PwC
Stuttgart

Für unseren Geschäftsbereich Consulting suchen wir dich zum nächstmöglichen Zeitpunkt als Senior Consultant / Manager Enterprise Architecture & Cloud Transformation Energiewirtschaft (w/m/d). Das erwa…

Details Anzeigen
Veröffentlicht am 2026-11-02

Facharzt (m/w/d) für Allgemeinmedizin und Familienmedizin

Peter Grill Ärztevermittlung
Stuttgart

Facharzt (m/w/d) für Allgemeinmedizin und Familienmedizin   Sie übernehmen die allgemeinmedizinische Betreuung der Patienten der Praxis.   Geboten wird: interessante und abwechslungsreic…

Details Anzeigen
Veröffentlicht am 2026-09-11

Projektingenieur:in ETCS (L2oS)

activjob GmbH - Bautzen
Stuttgart

Aufgaben, Kompetenzen und Verantwortung - Koordination und fachliche Bearbeitung komplexer technischer Fragestellungen im Projekt Digitaler Knoten Stuttgart (DKS) mit Schwerpunkt ETCS L2oS sowie der…

Details Anzeigen
Veröffentlicht am 2026-10-23

AI Go-to-Market Banking DACH Lead (w/m/x)

NTT DATA
Stuttgart

NTT DATA is a trusted global innovator of business and technology services, helping clients innovate, optimize, and transform for success. We strive to hire exceptional, innovative, and passionate in…

Details Anzeigen
Veröffentlicht am 2026-10-21

SAP SuccessFactors Berater (m/w/d) in Stuttgart bei führendem Systemhaus

KA Resources
Stuttgart

Ein führendes Systemhaus mit rund 4000 Mitarbeitern und dem erklärten Ziel die digitale Transformation voranzutreiben, mit angenehmer Arbeitsatmosphäre erwartet Sie bei unserem Kunden. Für den Einsat…

Details Anzeigen
Veröffentlicht am 2026-11-07

Duales Studium BWL-Handel (B. A.) 2027 in 70173 Stuttgart

dm-drogerie markt GmbH + Co. KG
Stuttgart

Du liebst es, den Alltag zu organisieren, übernimmst gerne Verantwortung und behältst das Wichtigste immer im Blick? Dann werde Teil unserer Arbeitsgemeinschaft und gestalte die besondere dm-Einkaufs…

Details Anzeigen
Veröffentlicht am 2026-07-16

Softwareentwickler (m/w/d)

AllatNet Recruiting GmbH & Co. KG
Stuttgart

Softwareentwickler (m/w/d) Referenz ID: 1330768 Finden Sie mit der AllatNet Recruiting Ihren Traum-Job. Durch unseren einzigartigen Kontakt zu Groß- und mittelständischen …

Details Anzeigen
Veröffentlicht am 2025-10-06

SAP Solution Architect (SAP CO) (f/i)

EPAM Systems
Stuttgart

Location: Landshut; Stuttgart; Augsburg; Munich; GermanyWork type: HybridSeniority: Associate ManagementPrimary skill: SAP FICOPosted: 2026-11-10Unternehmen stehen bei Transformationsprojekten vor der…

Details Anzeigen
Veröffentlicht am 2026-11-12