Recently game-based brain-computer interface (BCI) systems using electroencephalography (EEG) has been gaining popularity, providing a sophisticated experience to its users. Here we present such a novel hybrid system based on rapid serial visual presentation (RSVP) in conjunction with steady-state visual evoked potentials (SSVEP). Based on a matching computer game Jewel Quest a game is designed wherein a sequence of jewel images containing rare targets (< 3%) in an RSVP paradigm is presented on a display at four distinct locations each flickering at different rates (4, 5, 6 and 7 Hz). A score is awarded upon successful detection of target image from neural signals. During real-time implementation to achieve higher classification speeds, EEG signals were epoched at the onset of each image, creating a high degree of class overlap and imbalance. Given these challenges in our EEG datasets, we present classifiers that can classify single-trial EEG epochs at the onset of target image presentation accurately. Initial results from 14 subjects indicate Hidden Markov Model (HMM) with Dirichlet emission probabilities provide 1% higher, on average, the area under the precision-recall curve (AUC-PR) compared to the ensemble technique Bagging, commonly used to handle class imbalance.