It is clear from the text of Genesis 5 that Enoch was certainly viewed as being different from the other patriarchs. The major differences we can see within the text itself are that Enoch a) died early, and b) died in a manner different than the other patriarchs.
The patriarchs listed in Chapter 5 all lived between 777 and 969 years, except for Enoch, who lived 365 years. In addition, the other patriarchs were described as having died, using the Hebrew verb לָמוּת. However, the text decribes Enoch's death by stating that G-d took Enoch, using the Hebrew verb לָקַח, meaning to take. Verses 5:22 and 5:24 describe Enoch as walking with G-d. Here, the verb used to describe the act of walking is הִתְהַלֵּךְ. This is the hithpael reflexive from of halach, the latter which is used to describe simply physical walking. The verb הִתְהַלֵּךְ rarely appears in Tanach, and it is clear that the type of walking Enoch was doing was not everyday walking. Instead, it is assumed that Enoch walked with G-d in the sense of following in G-d's ways. Hopefully this also illustrates the importance and power of reading the Bible in the original text.
There is something of a consensus among both Jewish and Christian sources that Enoch was a righteous man. The view in Rabbincal literature is that G-d took Enoch's life to prevent him from being corrupted by the world. Hence his shortened life was actually a blessing rather than a punishment. In Christian theology, Enoch is also generally revered. In the Armenian Apostolic Church Enouch has a saints day, and the Mormon Church views him as having founded a righteous city called Zion.