Another good printed option is:
Hook, Line & Sinker by Daryl Crimp.
the sub-title 'What they look like, where to find them, and how to catch them' says it all.
It was first published 20 years ago, but the info re the fish species and basic fishing methods for each is still quite applicable for a newbie.
If you live in the upper North Island and bait or lure fish in the in-shore waters you'll typically encounter the classic common catches of snapper, kahawai, jack mackerel, trevally, kingfish, gurnard and various sharks/rays. John dory are another occasional catch. That's dependent on time of year, fishing zone and type of fishing, obviously.
The good thing about that book i mentioned is that if you live in another part of the country, it includes the common species there.
There is also a lot of good info on this forum in the advice section.
NZers tend to turn their noses up at so-called lesser table fish, often just based on what they've been told, which is a bit sad as we miss out on some delicious eating. But as MB said, correctly treating and cooking fish is the key. e.g. kahawai is stunning eating in my view (raw fish dishes, Thai curries, fish cakes), but biffed back by many.
Last thing - I'd encourage you to familiarise yourself with the regulations about minimum sizes and bag limits.