I caught a fish but don't want to keep it. Can I release it into another lake or river?

No, it is illegal to release any fish into public waters unless caught from that water.