So you don't believe official data because you and your mates haven't been surveyed? Well that's rigorous isn't it (not).
In any case here is some Qld research. I know it's a while back from 2007, but it describes a sharp drop in angling participation. It cites reason which you obviously haven't thought of such as high costs of boating, time constraints, competing recreations:
Constraints on recreational fishing participation in Queensland, Australia - ResearchOnline@JCU
Also the 2019/20 rec fishing survey describes participation as 'similar to previous years":
Statewide recreational fishing surveys | Department of Agriculture and Fisheries, Queensland (daf.qld.gov.au)