Even if you didn't work in the food industry I would strongly advise you to stay home. Not only are you probably contagious, but you need rest to get over it. You'll just run yourself ragged and make your illness worse by trying to work with a fever.
I doubt you feel good enough to work anyway.
They would really give you grief for not coming to work when you have a fever? That's just wrong.