Shem had a whole language group and a large ethnic population named after him. This is a much greater legacy than the mere poetic mention of the "land of Ham," in scripture as an alternative name for Egypt - a name virtually forgotten today.
The Semitic language group includes "Arabic, Amharic, Aramaic, Hebrew, and numerous other ancient and modern languages. They are spoken by more than 330 million people across much of West Asia, North Africa, the Horn of Africa, Malta, and in large immigrant and expatriate communities in North America, Europe, and Australasia." footnote 1
The term "Semite" has fallen out of favor, but it still refers to "Arabs, Akkadians, Canaanites, Hebrews, some Ethiopians (including the Amhara and the Tigrayans), and Aramaean tribes. Although Mesopotamia, the western coast of the Mediterranean, the Arabian Peninsula, and the Horn of Africa have all been proposed as possible sites for the prehistoric origins of Semitic-speaking populations." footnote 2
Conclusion: Having a land associated with his name in scripture long after his death is no endorsement of Ham. In fact, it was Shem who was blessed - by having a large ethnic and language group named for him, a name that endures to this day. Indeed, even the actual "Land of Ham" (Egypt) today speaks a Semitic language and is populated by descended of the biblical Shem.