SAP has updated their certification process with their latest BTP Solution Architect exam, and I passed my certification exam this weekend. Unlike the traditional SAP certification exams, this one leverages AI technology to create a realistic role-play assessment experience.
After you start the BTP solution architect exam, you are presented with a case study which is a protected pdf- which contains a case study around a BTP scenario. You can then choose whether to engage in role-play or upload a video of the your proposed solution, which will be reviewed by SAP.
I spent a couple hours reviewing the case study and researching the various aspects of the solution that would be presented, by reviewing the BTP learning journey, SAP BTP Guidance Framework. It was daunting as you really don't know what will happen after you press the "Start" button.
The exam uses Yoodli technology “under the hood” and requires no software prerequisites to be installed - you just need to allow access to your camera and microphone.
After reading and analyzing the BTP case study, you begin the actual assessment. A interactive chat window appears with the companies CIO and starts with a friendly introduction. The interview is life like - similar experience to having a Zoom call with someone - you can see a transcript of what is being said at the bottom of the screen (the CIO is just an avatar, that speaks naturally).
The “AI” CIO asks about your general BTP solution approach and components, then digs into specifics in what feels like a natural conversation. Just like in the real world, the CIO interrupts you and asks you to be more clear about specific components, creating an authentic consulting scenario. He asks about specific components and your rationale and reasons.
I am not sure exactly how long the entire interview process took, I would estimate between 15 and 20 minutes.
The system takes a minute or two at the end to complete the assessment and provides your certification score across a number of dimensions and feedback. I found the insights to be really good, making it overall a great experience - but after closing the exam I didn't have access to them again - pity.
The BTP solution architect learning journey should equip you with the information you need, though I'm not sure how varied the case studies are. What strikes me most is how AI is really going after education. This proves how AI is going to take away jobs, but also make certification much more meaningful in the future—the days of students just learning practice questions are over, and I think this is good for the industry.
This new format represents a significant shift from memory-based testing to real-world application and conversational competency. If you're preparing for SAP BTP certification, be ready for an experience that's much closer to an actual client engagement than a tradition AI bot. That's good for SAP and good fot the industry.
I would recommend cndidates to sign-up for a free account at yoodli (it has a free tier) and undertake some roleplay examples, this will give you a feel for how the technology works and get you comfortable talking to the AI and learning how the interactions work.
I have a fibre connection at home, but did see some “unstable network” banner warnings during the interview process, so declutter as much as possible and ensure you computer and connection are crisp as possible, switch off VPNs etc.
This is AI :) use specific words and be precise as possible, was surprised how detailed the follow up questions were. There is a timer and felt like there was enough time to answer thoroughly. I use mindmaps extensively so found this a good guide to use across the various architecture topics.
VMG Labs believes strongly in equiping our consultants with the tools to deliver the most value for our clients, please check out our careers site and share any thoughts or feedback you have.