When JPG is the better choice
Photos are usually many times smaller as JPG than as PNG. That helps when sending by email, uploading to portals with a size limit and on web pages that should load fast. Many forms, shops and print services only accept JPG anyway.
When you should keep the PNG
Screenshots, logos, diagrams and graphics with text consist of sharp edges and few colours. JPG handles that badly: the file barely gets smaller and edges pick up a slight haze. If you need transparency, PNG is the only option anyway.
Transparency and background colour
A cut-out logo or product image has transparent areas. In a JPG they have to be given a colour. Use the colour of the surface the image will sit on, then the transition goes unnoticed. White suits documents and most web pages.
The other way round
Need a PNG from a photo? There is JPG to PNG for that. You can send several images as one document with PNG to PDF, and make large photos smaller with Compress image.