Toya brothers Walter & Casey had to deal with the lost of their bros from prison, so they couldn't even cry