Bandits have to be worth finding. At their current spawn rate, with the current selection of item drops, they're not. If I could be sure I'd find something I'd want to play with, I might hunt for it. If they spawned enough to make it worth it, I'd hunt them. If the drop rate was high enough, I'd hunt it. But none of these things are true. The drop rate is low, they drop junk a lot (goblets are worthless to me, spiderweb is worthless to me, etc), and not a huge ton of them spawn.

So basically, Noola is right. Killing one and getting nothing is sad. Killing a dozen and getting nothing means I ignore this entirely.