High-Dose Vorinostat and Fractionated Stereotactic Body Radiation Therapy in Treating Patients With Recurrent Glioma

Inclusion Criteria: * Patients must have a previously histologically or cytologically confirmed glioma (astrocytic or oligodendroglial supratentorial tumors grades 3 or 4 according to the World Health Organization \[WHO\] 2007 classification) that has been previously treated with fractionated radiation therapy and now shows evidence of recurrence * Patients must have recovered from the toxic effects of prior therapy * Patients must have recovered from the effects of any prior surgery to any part of the body; there must be a minimum of 28 days from the day of surgery to the day of registration; for core or needle biopsy, a minimum of 7 days must have elapsed prior to registration * Patients may have previously undergone more than one craniotomy * Prior treatment with cytotoxic and biological agents is permissible; there should be at least a 2 week break between prior treatment and enrollment; (in the case of bevacizumab, since this trial involves surgery, at least 4 weeks should elapse between last dose of drug and enrollment, in the case of nitrosoureas or mitomycin C, at least 6 weeks) * Prior treatment with fractionated radiation therapy (up to 60 Gray \[Gy\]) is an eligibility criterion, however this should have been completed \>= 4 weeks prior to enrollment and there should not have been a second course of fractionated radiotherapy to the supratentorial area * One prior single fraction radiosurgical procedure within the treatment field is acceptable if V12 \< 5 cc (V12 is the volume of brain receiving 12 or more Gy); additional radiosurgical procedures outside of the treatment area are acceptable * Patients should not have received prior histone deacetylase therapy (HDAC) therapy, an exception being the anti-seizure medicine valproic acid; however even valproic acid should not be given concurrently with vorinostat * Eastern Cooperative Oncology Group (ECOG) performance status =\< 2 (Karnofsky \>= 60%) * Life expectancy of greater than 2 months * Leukocytes \>= 3,000/mcL * Absolute neutrophil count \>= 1,500/mcL * Platelets \>= 100,000/mcL * Total bilirubin within normal institutional limits * Aspartate aminotransferase (AST) (serum glutamic oxaloacetic transaminase \[SGOT\])/alanine aminotransferase (ALT) (serum glutamic pyruvic transaminase \[SGPT\]) =\< 2.5 X institutional upper limit of normal * Creatinine within normal institutional limits OR creatinine clearance \>= 60 mL/min/1.73 m\^2 for patients with creatinine levels above institutional normal * Prothrombin time/international normalized ratio (PT INR) \< 1.4 for patients not on warfarin * Women of childbearing potential must have a negative beta-human chorionic gonadotropin (HCG) pregnancy test documented within 7 days prior to registration * Women of child-bearing potential and men must agree to use adequate contraception (hormonal or barrier method of birth control; abstinence) prior to study entry and for the duration of study participation; the effects of vorinostat on the developing human fetus are unknown; HDAC inhibitor agents as well as the ionizing radiation used in this trial are known to be teratogenic; should a woman become pregnant or suspect she is pregnant while participating in this study, she should inform her treating physician immediately * Ability to understand and the willingness to sign a written informed consent document Exclusion Criteria: * Patients who have had: * Radiotherapy within 4 weeks * Chemotherapy/biological agents (excluding bevacizumab, nitrosoureas and mitomycin C) within 2 weeks * Bevacizumab within 4 weeks * Nitrosoureas and mitomycin C within 6 weeks prior to entering the study * Those who have not recovered from acute adverse events due to any prior therapeutic agents * Patients may not be receiving any other investigational agents * Evidence of recent myocardial infarction or ischemia by the findings of S-T elevations of \>= 2 mm using the analysis of an electrocardiogram (EKG) performed within 14 days of registration * A history of long QT syndrome, or corrected QTc (QTc) prolongations \> 470 ms at baseline * History of allergic reactions attributed to compounds of similar chemical or biologic composition to vorinostat or other HDAC inhibitor or other agents used in study * Uncontrolled intercurrent illness including, but not limited to, ongoing or active infection, symptomatic congestive heart failure, unstable angina pectoris, cardiac arrhythmia, or psychiatric illness/social situations that would limit compliance with study requirements * Pregnant women are excluded from this study because vorinostat is an antineoplastic agent with the potential for teratogenic or abortifacient effects, class D; because there is an unknown but potential risk for adverse events in nursing infants secondary to treatment of the mother with vorinostat, breastfeeding should be discontinued if the mother is treated with vorinostat; these potential risks may also apply to other agents used in this study