Vaccine Therapy and Sargramostim in Treating Patients With Malignant Glioma

Inclusion Criteria: * Histologic proof of one of the following: glioblastoma multiforme, anaplastic astrocytoma, anaplastic oligodendroglioma or anaplastic mixed glioma or anaplastic oligoastrocytoma * Must have recurrent or progressive disease following standard therapy * Karnofsky performance status (KPS) greater than or equal to 70 * Human leukocyte antigen (HLA)-A \*02 or HLA-A \*03 blood cell haplotype documented by polymerase chain reaction (PCR) analysis or flow cytometry * Survivin expression on patient's tumor cells documented by immunohistochemistry * Must be free of systemic infection; subjects with active infections (whether or not they require antibiotic therapy) may be eligible after complete resolution of the infection; subjects on antibiotic therapy must be off antibiotics for at least 7 days before beginning treatment * White blood count \>= 3000/mm\^3 * Platelets \>= 100,000/mm\^3 * Hemoglobin \>= 10.0 g/dL * Aspartate aminotransferase (AST)(serum glutamic oxaloacetic transaminase \[SGOT\])/alanine aminotransferase (ALT)(serum glutamate pyruvate transaminase \[SGPT\]) =\< 2.5 x institutional upper limit of normal (ULN) * Total bilirubin =\< 2.0 mg/dL * Serum creatinine =\< 1.5 x institutional upper limit of normal (ULN) * Patients of child-bearing potential must agree to use acceptable contraceptive methods during treatment and for three months after its completion; women must have a negative serum pregnancy test * Patients who have had recent cranial surgery are eligible for inclusion, but the vaccine may not be administered prior to post-operative day 14 * Patient or legal representative must be able to read, understand the investigational nature of this study and sign an Institutional Review Board approved written informed consent form prior to receiving any study related procedure Exclusion Criteria: * Inability to obtain histologic proof of malignancy or material unavailable for survivin testing * Systemic corticosteroid therapy \> 12 mg of dexamethasone or equivalent per day at study entry; patient should be on stable dose * HLA-A \*02 or HLA-A \*03 negative * Active infection requiring treatment (including human immunodeficiency virus \[HIV\] infection) * Any medical condition that, in the opinion of the principal investigator, would compromise the patient's ability to participate in the study; this includes chronic active hepatitis infection, immunodeficiency disease, concurrent neurological condition or autoimmune disease * Any of the following: pregnant or nursing women, or women of childbearing potential or their sexual partners who are unwilling to employ effective contraception (condoms, diaphragm, birth control pills, injections, intrauterine device, surgical sterilization, subcutaneous implants or abstinence) * Concurrent chemotherapy, immunotherapy, radiotherapy, radiosurgery, interferon (e.g. Intron-A), allergy desensitization injections; growth factors (e.g. Procrit, Aranesp, Neulasta), interleukins (e.g. Proleukin) or any investigational therapeutic medication * Evidence of current drug or alcohol abuse or psychiatric impairment, which in the investigator's opinion will prevent completion of the protocol therapy or follow-up * Use of any experimental drug for any reason within the 30 days, or standard of care drug therapy within 28 days prior to randomization, or failure to fully recover from hematological effects of prior chemotherapy * Known allergy or hypersensitivity to keyhole limpet hemocyanin (KLH), GM-CSF or magnetic resonance imaging (MRI) contrast agent * Life expectancy less than 4 months * Any prior autoimmune disorders requiring cytotoxic or immunosuppressive therapy, or autoimmune disorders with visceral involvement; participants with mild arthritis requiring nonsteroidal anti-inflammatory drug (NSAID) medications will not be excluded * Participants who have another cancer diagnosis will be ineligible, except for those with: squamous cell cancer of the skin without known metastasis, basal cell cancer of the skin without known metastasis, carcinoma in situ of the breast (ductal carcinoma in situ \[DCIS\] or lobular carcinoma in situ \[LCIS\]), carcinoma in situ of the cervix and any cancer without distant metastasis that has been treated successfully, without evidence of recurrence or metastasis for over 5 years * Unwilling or unable to follow protocol requirements * Any condition which in the investigator's opinion deems the patient an unsuitable candidate to receive study drug