To change your avatar, click your avatar in the bar at the top right. Then click your avatar again in the pop-up. You can change the colors or upload a profile picture.
Your avatar (profile picture) is shown below your own albums and below albums you've bookmarked. The album owner can choose to turn this off.