Post History
In addition to Galastel's answer, I would add the non-writing worry: People that know you, including your brother and family and possibly friends, may read your book and recognize you, themselves, ...
Answer
#1: Initial revision
In addition to Galastel's answer, I would add the non-writing worry: People that know you, including your brother and family and possibly friends, may read your book and recognize you, themselves, and other characters in the book. Correctly or mistakenly. And then take you to task for putting them in prison, killing them, or making them say something mean or criminal or sexual, or do something "they would never do." I think every writer puts something of themselves into characters, perhaps exaggerates their own strengths and weaknesses, but for the purpose of the story MUST invent antagonistic elements and kick their hero in the head once in awhile. (At least once). Non-writers may not understand this, and think if you are going to write a fictional account of them, you need to leave all the bad stuff (fictional or real) out of it. That you shouldn't be airing dirty family laundry in a book that millions of people might read.