Use a LEFT JOIN to get all items from artist and only the matching ones from album.
LEFT JOIN
artist
album
Make sure to type LEFT JOIN.