I agree more white would be a great place to start.
I know you are just trying to learn things with the color palette limitations, and make your site with color blind users, which is great, but I really feel like you are approaching this wrong.
Instead you might be better off developing a...