Please do not use flax oil for this.
Olive oil is rich in monounsaturated fat, the one that's been associated with helping your boys turn cholesterol into testosterone.
Olive oil converts cholesterol more easily into testosterone
Flax oil is high in polyunsaturated fat - but the plant form "ALA", not the animal forms EPA/DHA. This is a problem if you consume too much of it, since humans suck at the conversion via delta-6-desaturase. Men's bodies are particularly bad at this conversion, which may be slightly better (but still lousy) in young women (conversion rates are positively correlated with estrogen levels). Polyunsaturates are necessary for human health, but more is NOT better: they promote inflammation in the body.
A decent rule of thumb is to set minimal fat intake at half a gram per pound lean mass, with about a third coming from each of monos, saturates and polyunsaturates and at least 3g coming from EPA/DHA (the uber-conservative AHA says 3g combined EPA/DHA is GRAS - "generally regarded as safe" - without a doctor's supervision). If you go higher than half a gram per pound lean mass, lean on the monos and saturates for the extra to get most of your fats from monos, then saturates, and the least from polys.
As an example, I carry about 120 lbs lean mass, so my fat intake is minimally at least 60g daily; 20g mono, 20g saturated, 20g poly (of which 3g is the combined EPA/DHA provided by the ten capsules of fish oil I consume daily). I generally like my fat intake closer to 100g daily, so I lean on olive oil, raw nuts, avocados, and butter for the extra.
For your omega-3, stick to oily, cold-water fish and fish oils.