I agree with Andy - it is not an all or nothing thing. Eliminate eggs, meat and fish and maybe cheese/milk 100% from your diet and then try and do what you can in other areas.
Well done for what you have done already!
Perhaps you would do well to not label yourself as a vegan but mostly vegan.
Celebrate the fact that you can reduce your impact on animal cruelty by 99% even if that last 1% is difficult. You may be buying many non-vegan products but if they are mostly containing animal products in small quantities they are probably quite small compared to the impact caused by regular meat eating.
Buy the vegan products that you can easily find to start with, but don't overdo it on trying to get every product 100% vegan in all cases. I don't.
Build up your knowledge over time of what products are vegan and become steadily more vegan over time, but don't feel like you have to learn how to buy every product vegan overnight.