It's smart to focus on the foods you both CAN have instead of just thinking about what you can't have. It's a much healthier mindset.
A few thoughts about some of the items on your list:
Be very wary of "non dairy milk","soy cheese", "vegan ice cream/popsicles" and "whole pumpernickel bread." All of those items CAN be compliant, but are also likely to have hidden "avoids" in the ingredient list, so read ingredients carefully. Wheat is often found in breads, even dark pumpernickel- so look for breads with just rye and/or spelt. Look for corn (in syrup and/or starch) and thickeners such as carrageenan in the fake dairy products (cheese, milk, and ice cream)- carrageenan is particularly toxic to the GI tract, yet is found in many organic and "natural" foods.
Overall, the shopping list looks good. Keeping goat milk in there is a reasonable compromise for now. You may want to consider using mozzarella, feta, and goat cheese as an alternative to the soy cheese. If you have the time, you could make your own breads and/or milks- there are recipes for both rice milk and almond milk in the typebase. None of those things are hard to make, but they can be time consuming.
I also suggest that you have red meat at least a couple of times a month, if not several times a week. Clearly, that won't work for shared meals, but as an O you're unlikely to thrive without regularly consuming some red meat. You could have that for yourself at meals you don't eat together, or serve red meat for you and tofu for him at a shared meal.