Bookmark albums you like by clicking on the bookmark icon on top of the album. This way the album will be added to your overview. You will also be kept in the loop if something happens to the album (new photos added e.g.).
In old style albums the avatar will appear in the footer of the album under the header "bookmarked by" if the album owner hasn't disabled this.