I would agree, yes, that we can infer this if we take the reference to joking to mean that Lot might not have been in the habit of relaying that something from the Lord is of interest to anybody (I can think of no examples of that). Although, I get more from the implication that the sons-in-law had no idea anything wrong was even happening (Ref Luke 17:26-32, esp v.27 where marriage is mentioned as it is the marriage relationship that is emphasized with who these 2 men of an infamous city where marriage might have itself been a laughable [non-serious?] event: "People were eating and drinking, marrying and being given in marriage...)
There are other places where it is implied that Lot is not fully aligned with God's plans:
Gen 12:1 Then the LORD said to Abram, “Leave your country, your kindred, and your father’s household, and go to the land I will show you
This shows that God's plan was for Abram to leave his family and since it's physically not possible for Abram to have children with Lot (ahem) but Sarai is, she is "family" to go with Abram (even if she was "kindred" or of Abram's father's household, she has a role to play in God's plans) but Lot is not part of the plan, being "kindred" or possibly of Abram's father's household--meaning that Lot is Abram's brother's or sister's son. Thus, technically it is very possible that God was commanding Abram to not take Lot with him.
Then in Gen 12: 4 So Abram departed, as the LORD had directed him, and Lot went with him. Abram was seventy-five years old when he left Haran.
Notice the placement of Lot, after the "as the Lord had directed him". So it is implied that Lot was an add-on, not part of God's original plan for Abram.
Indeed, Lot proves to be a thorn in Abram's life over and over:
- Gen 13:5-9 Herdsmen contention
- Gen 13:10-11 Lot chose the easy life, perhaps to the dismay and certainly to the agricultural inconvenience of his uncle.
- Gen 14:10-15 Lot had to be rescued, entangling Abram in regional wars and tension that continued for years.
- Gen 18:16-33 Abram interceded for the life of Lot in a situation where God has heard of the wickedness in Sodom (in a foreshadowing moment of one man sacrificing himself for many others)
- Gen 19:1 Lot, whatever his herdsmen skills when he first arrived, has become a city elder of Sodom--at the city gates. This is not a position one would fall into, thus he must be at the very least aware of the evil of Sodom (and alludes that he knows rape is ahead, in the act of men taking spiritual beings to have sex with them, in verse 8, a reversal of Gen 6:1-2).
I know you didn't ask, but the "looking back" of Lot's wife doesn't say much good about her either and they were a family unit, so...
Of course, the final confusing and despicable act of getting so drunk as to not know he was having sex with his daughters (which raises all kinds of questions of any pressures he was putting on his daughters to get married or live in caves forever or was he a common drunk or was he grieving or just...what?).
In this, we see God's ability to take something which was NOT part of the original plan and weave it in as Ruth, a Moabitess, a daughter of Lot so-to-speak, is placed in the direct lineage of Jesus.
Hat tip to 2 Peter 2:4-10 as I think Peter is making a point that one can live in an ungodly world, have it bother you, and still have to chose every day one's actions for God. Thus, I am neither saying that Lot was good or bad in nature; he was human, a mixture of both.