Why do people with fragile X syndrome, a genetic defect that is the best-known cause of autism and inherited mental retardation, recoil from hugs and physical touch? New research has found in fragile X syndrome there is delayed development of the sensory cortex, the part of the brain that responds to touch, according to a study from Northwestern University. This delay may trigger a domino effect and cause further problems with wiring of the brain.