It's not about him being threatened. He displayed an attack that he initially believed was above his skill level. He saw his potential as a swordsman and that's why he let him live.
Guys, I never said it was consistent. I'm just saying that it was what the story implied. Toyo isn't going to display his narrative on how well Black can take the blows from Vegeta or whatever.
I think the intent was that a SSJB before the drain is basically just the power of CSSJB. I know Vegeta lost to Black right after eating a Senzu but that’s just Toyo being Toyo.