Newbie here: How to improve AI chatbot performance for support?

Hi everyone, I'm super new to the SaaS world and just launched my first tiny app. I've been following the discussions here about support automation acting up, and honestly, it's making me a bit nervous about my own setup.

I'm trying to implement a basic AI chatbot to handle initial customer queries, but its AI chatbot performance is really struggling. It often misunderstands simple questions or routes tickets incorrectly, which creates more work for me than it saves. I know I'm probably making some fundamental mistakes since I'm a total beginner.

For someone just starting out, what are the absolute first things I should check or common beginner traps to avoid when setting up an AI chatbot for customer support? Any simple tips to improve its basic functionality and accuracy would be incredibly helpful.