Aiwass didn't go out of his way to differentiate who were the incorrigibly loyal blood slaves to the Count of Orleans and who were innocent victims kidnapped and brought here.
On this point, he and Sherlock had different views—
Sherlock, from a legal perspective, viewed those blood slaves as "coerced accomplices." Having a background as a Legal Mage from Avalon, it's only natural for him to feel this way.
The laws of Avalon and Star Antimony differ notably in that Avalon's laws do not recognize the necessity defense rules for harming others to save one's own life, while Star Antimony's laws allow for this.
Specifically, if a kidnapper threatens someone, ordering them to go out and randomly kill someone, and if they don't, they'll be killed themselves—in Avalon, this threatened person would still be prosecuted as a murderer. Whereas in Star Antimony, even if they couldn't be deemed innocent, their culpability would be at least mitigated.