Start with the bird itself: a sea bird so large that its wings, opened out, are longer than a person is tall. It is heavy, it lives far out over the open ocean, and most people go a whole life without seeing one. Two things about that picture get borrowed by the other uses. One is the sheer weight and size — something that big cannot be hidden or put down. The other is how rare the sighting is — an albatross is the thing you almost never get.
The source records the name as uncertain: probably from Spanish or Portuguese alcatraz (pelican, gannet), possibly going back to an Arabic word meaning the diver, with the spelling later pulled toward Latin albus, white. That last pull is why the bird is so often described as the white one.
來源不確定。資料上說可能來自西班牙文或葡萄牙文的 alcatraz（鵜鶘、鰹鳥），再往上也許是阿拉伯文裡「潛水的那個」。後來拼法受到拉丁文 albus（白色）影響，所以字首才寫成 alb-。這也呼應了字典裡總是說牠是「白色的大海鳥」。
Wiktionary (kaikki) entry for albatross, source_ref kaikki:3f6f69a190036ae4:703095395
From the picture
掛在脖子上的重量
借的是「大到藏不住」這一面：把那麼重的一隻鳥掛在脖子上，走到哪都得帶著。
noun · C1
Something you are stuck with that keeps causing you trouble and stops you from succeeding. The full form is an albatross around someone's neck, but the part around your neck is often left out, and albatross alone carries the same meaning.
甩不掉的包袱
高爾夫的鳥名階梯
借的是「難得一見」這一面：低一桿是小鳥，低兩桿是老鷹，低三桿就搬出這隻幾乎見不到的大鳥。這是一種幫助記憶的聯想，不是歷史上的字源說明。
noun · C1
In golf: a score of three strokes under par on a single hole, also called a double eagle. It cannot happen on a par 3 hole.
信天翁（高爾夫：低於標準桿三桿）
noun · B2
A very large white sea bird with long narrow wings and a hooked beak, which lives over the open ocean, mainly in the Southern Ocean and the North Pacific.
信天翁