Have a look at the Gap knitwear section - there are lots of tops and cardigans on there that I think would look okay with a shortish casual-ish skirt. I prefer the plain or stripy stuff, but that's just me.
My rule would be no longer than top of hips for wearing with a flared skirt, but with a straight skirt you could wear longer tops, especially cardigans:
Gap