QA Engineer – Agentic Gateway Testing
On-site in Portugal·Added 8 days ago
Overview
Requirements
Work on-site in Portugal
No relocation package mentioned.
Have 4+ years of experience
Mid-level role.
Pay & benefits
What you'll get
At Intellias, where technology takes center stage, people always come before processes. By creating a comfortable atmosphere in our team, we empower individuals to unlock their true potential and achieve extraordinary results. That’s why we offer a range of benefits that support your well-being and charge your professional growth.
We are committed to fostering equity, diversity, and inclusion as an equal opportunity employer. All applicants will be considered for employment without discrimination based on race, color, religion, age, gender, nationality, disability, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by applicable law.
We welcome and celebrate the uniqueness of every individual. Join Intellias for a career where your perspectives and contributions are vital to our shared success.
The role
We are looking for a QA Engineer specializing in Agentic Gateway Testing to ensure the reliability, security, performance, and observability of agentic workflows and tool integrations. The role focuses on testing MCP-based interactions, multi-step agent workflows, authorization controls, performance characteristics, and end-to-end traceability across an enterprise agentic platform.
Our client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.
The project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases.
The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution.
What you'll do
- Design and execute tests for agentic workflows, including tool discovery, tool invocation, and multi-step agent interactions.
- Validate MCP protocol behavior, including tool list aggregation, tool-call routing, and streaming responses.
- Test authorization and authentication controls, including unauthorized tool-access scenarios and policy-enforcement validation.
- Perform performance testing for agentic workloads, including tool-discovery latency, concurrent agent sessions, and agent-to-agent communication latency.
- Build and maintain automated tests in Python using pytest, including asynchronous testing, mock MCP servers, and agent workflow simulations.
- Validate agentic observability, including trace completeness, agent-step logging, and audit trails.
- Perform end-to-end testing across agent, gateway, and tool interaction flows.
- Identify reliability, security, and performance issues in complex agent workflows and support their resolution.
Skills
• Agentic workflow testing — agent tool discovery, tool invocation, multi-step agent workflows
• MCP protocol testing — tool list aggregation, tool call routing, streaming response handling
• Agent authorization testing — unauthorized tool access attempts, policy enforcement validation
• Agent performance testing — tool discovery latency, concurrent agent sessions, agent-to-agent latency
• Python test automation — pytest with async, mock MCP servers, agent workflow simulation
• Agentic observability validation — trace completeness, agent step logging, audit trail verification
Experience
• 4+ years QA engineering for AI/ML or agent systems
• Tested LLM agent workflows (tool calling, multi-step reasoning)
• Security testing for authorization and authentication
• Performance benchmarking for cloud services
Nice to have
• MCP protocol testing experience
• Agent framework testing (LangChain, LangGraph, Crew)
• AWS Bedrock Agents testing
• Chaos engineering for agentic systems
• Audit log validation (CloudTrail, OpenTelemetry traces)
About Intellias
Intellias is an AI-enabled product engineering and digital solutions partner, operating in the IT services industry. The company has over 20 years of engineering experience, employs more than 3,000 AI-enabled engineers, and serves over 170 enterprise clients worldwide. Intellias delivers digital products across mobility, healthcare and life sciences, financial services and insurance, retail, and iGaming, with a global network spanning 17 countries and 23 offices.
Intellias has a presence in Spain, with a validated office location in Malaga. The company's global delivery model and focus on senior engineering talent make it a relevant employer for international professionals, particularly those with expertise in software engineering, data engineering, AI/ML, and cloud infrastructure. With roles open in Spain across various engineering and architecture disciplines, Intellias offers opportunities for experienced professionals to work on complex, enterprise-scale projects.
- Industry
- IT Services
- Founded
- 2002
- Employees
- 3,000–5,000
- Headquarters
- Lviv, Ukraine
- Website
- intellias.com
More jobs like this
or browse QA & testing·Mid-level·IT Services
