Interior fabric

Hi all,
I have a 2007 Honda accord and the interior velour seats seem to be a dust and lint magnet.
Mine is picking up every single piece of lint and dust and it looks quite disgusting after a week of cleaning and I only drive my car a very short distance daily. It also appears that the fibres that make up the fabric isnt helping matters.
I cant just clean with a lint roller or vaccum, I have to use a fabric comb to clean it on every section of the seats, front, back, side pockets and all and even then it never looks 100% clean.
Apparently Honda has never had such a complaint about their velour seats and I was told perhaps its my clothes, which I take great offence to as I wear what everyone else would normally wear!
Funny we showed the Honda tech the same issue on a new car in the lot but he didnt seem interested for some reason!
Has anyone else had this issue?

Thanks for your help