Enough or to much?
I normally eat a 50g bag of raw almonds a day with a apple as a snack
That's about double the nuts per day that is recommended by nutritionists. Almonds are "healthy" but have a lot of calories from fat.
Nuts provide a little protein but not enough to balance out the fat. Nuts provide a good fat for our healthy diet, but too much is, of, course, too much.
The first reason is the simple fact that fat has tons of calories and if you eat just a little too much suddenly your whole nutritional balance is shifted.
You should maybe save some of those fat calories for your other meals.