Journal List > J Korean Med Sci > v.34(Suppl 1) > 1124743

Yeo, Kim, Her, Choi, Cha, and Kim: Spatiotemporal Analysis of Event-related Current Density Reveals Dissociable Effects of Arousal and Valence on Emotional Picture Processing

Abstract

Background

The processing of emotional visual stimulation involves the processing of emotional and visuoperceptual information. It is not completely revealed how the valence and arousal affect these two aspects. The objective was to investigate the effects of valence and arousal on spatiotemporal characteristics of cortical information processing using distributed source imaging of event-related current density (ERCD).

Methods

Electroencephalograms (64 channels) were recorded from 19 healthy men while presenting affective pictures. Distributed source localization analysis was adopted to obtain the spatiotemporal pattern of ERCD on cortical surface in response to emotional visual stimulation. A nonparametric cluster-based permutation test was used to find meaningful time and space without prior knowledge.

Results

Significant changes of ERCD in 400–800 ms among positive, negative, and neutral emotional conditions were found in left posterior cingulate cortex (PCC) and right inferior temporal cortex (ITC). In the PCC, the stimuli with higher arousal levels showed more negative ERCD than neutral stimuli. In the ITC, the ERCD for negative stimuli was significantly more negative than those of positive and neutral ones.

Conclusion

Arousal and valence had strong influence on memory encoding and visual analysis at late period. The location and time showing significant change in neural activity according to arousal and valence would provide valuable information for understanding the changes of cortical function by neuropsychiatric disorders.

Graphical Abstract

jkms-34-e146-abf001

INTRODUCTION

Various emotional states exist as the human nervous system has been developed so as to react appropriately to external stimuli. Russell's model,1 which is widely used as a reference for emotional distinction, classifies emotional states according to two dimensions, arousal and valence. The influence of valence and arousal on cortical information processing has been extensively studied. Emotion induced by visual stimuli provides an opportunity to explore emotional information processing. A number of previous studies have investigated the cortical information processing process in response to visual emotional stimuli.2345678 Furthermore, it has been pursued to understand the changes of emotional information processing according to neuropsychiatric disorders such as major depressive disorder and alexithymia,9 as well as degenerative brain disease.10
Emotional visual stimuli induce not only emotional information processing but also visuoperceptual processing.11 Valence is a central feature of emotion, contrasting the effects of positive versus negative states. Arousal is the physiological state of being awoken. The dimension of arousal ranges from calming to exciting. It is not completely revealed how the valence and arousal affect these two procedures. Emotional information draws attention immediately (within less than around 200 ms), and initial sensory information processing is usually enhanced by emotional stimuli compared to neutral ones.12 Both arousal and valence of the stimuli may affect sensory processing, as it has been demonstrated that the stimuli with high arousal and low valence induce significantly enhanced brain activities.712 On the other hand, emotional stimuli are motivationally relevant, and thus, cause strong memory encoding even when the encoding is not intended.13 It is well known that both arousal and valence are involved in herein.31415
Spatiotemporal functional neuroimaging technology is required to quantitatively characterize the effects of valence and arousal dimension on the constituent steps of visual emotional information processing. Noninvasive functional brain mapping studies have been performed on this issue using either electroencephalogram (EEG), magnetoencephalogram (MEG), or functional magnetic resonance imaging (fMRI).16 However, dynamic spatiotemporal neuroimaging is necessary in order to overcome the inherent limitations in spatial (EEG/MEG) and temporal (fMRI) resolution and to reveal neural substrates and their temporal behaviors.
The purpose of this study is to quantitatively investigate the effects of valence and arousal on spatiotemporal cortical information processing of emotional visual stimuli. Overall cognitive process can be divided into several units which may be based on overlapping spatial and temporal neural substrates. Distributed source localization analysis of EEG was adopted to characterize the spatiotemporal pattern of event-related cortical current density (ERCD) in response to emotional visual stimulation. A nonparametric cluster-based permutation test17 was used to find meaningful time and space without a priori knowledge. This enables us to find the spatiotemporal clusters showing significant differences between emotional states, based on the assumption that meaningful information processing units have spatially and temporally localized neural substrates.
Here our focus was on visuoperceptual analysis and memory encoding among the many constituent units of overall cortical processing. The memory encoding is expected to be specifically affected by arousal level, since stimuli evoking higher arousal are motivationally relevant, and cortical regions within the parietal memory network,18 which are found to be involved in memory encoding and retrieval processes, is expected to be involved here. The stimuli with positive/negative valence are expected to result in enhanced visuoperceptual processing compared to neutral ones. In particular, negative valence would cause enhanced visuoperceptual processing, presumably within inferior temporal cortical activity, presumably due to visual morphological feature processing during the memory encoding which is unintentionally, but automatically induced.1920 The results of this study may provide valuable information for understanding the changes of cortical function according to neuropsychiatric disorders.

METHODS

Participants

Nineteen healthy men without any history of neurological and psychiatric illnesses participated in the study (23.18 ± 1.92 years). Only men subjects were recruited to minimize the impact of potentially confounding variable according to gender differences in the cortical processing of visual emotional stimuli, (which is not direct interest of our study).21 All subjects were undergraduate students of Yonsei University and had normal or corrected-to-normal vision.

Visual stimuli

The visual stimuli were constructed from the International Affective Picture System (IAPS).22 The selection of images was performed based on the valence and arousal levels reported by the participants. We selected 100 images that may induce positive emotion (valence, 6.92 ± 0.56; arousal, 5.52 ± 0.75), 100 images that may induce negative emotion (valence, 2.48 ± 0.45; arousal, 5.66 ± 0.72), and 200 non-emotional pictures (valence, 4.97 ± 0.51; arousal, 3.65 ± 1.04). The IAPS stimuli used in this experiment for each condition are specified in Table 1. The number of neutral stimuli was set to be equal to the sum of positive and negative stimuli, so that the numbers of emotional and neutral stimuli were matched. Valence levels of the two emotional categories (positive and negative) were found to be significantly different (independent t-test, t(198) = 69.78, P < 0.001, Bonferroni corrected), but there was no significant difference in arousal levels of them (independent t-test, t(198) = −1.60, P = 0.330, Bonferroni corrected).
Table 1

The number of IAPS pictures used in the experiment

jkms-34-e146-i001
Pictures The No. of IAPS pictures
Pleasant (n = 100) 1560, 1590, 1595, 1640, 1650, 1659, 1710, 1720, 1721, 1722, 1731, 1740, 1810, 1811, 1947, 1999, 2018, 2019, 2025, 2030, 2034, 2045, 2071, 2075, 2150, 2152, 2153, 2154, 2155, 2158, 2160, 2208, 2209, 2216, 2224, 2300, 2303, 2311, 2340, 2345, 2346, 2347, 2362, 2373, 2374, 2389, 2391, 2398, 2605, 2616, 4006, 4007, 4008, 4071, 4090, 4130, 4150, 4225, 4250, 4255, 4274, 4275, 4279, 4325, 4597, 4598, 4599, 4601, 4603, 4606, 4607, 4608, 4609, 4610, 4612, 4619, 4623, 4624, 4625, 4626, 4628, 4640, 4641, 4643, 4645, 4653, 5215, 5220, 5260, 5270, 5300, 5301, 5450, 5460, 5470, 5480, 5600, 5621, 5622, 8500
Unpleasant (n = 100) 2095, 2301, 2717, 2190, 2800, 2811, 2900, 3000, 3001, 3010, 3015, 3016, 3017, 3030, 3051, 3053, 3059, 3060, 3061, 3062, 3063, 3064, 3068, 3069, 3071, 3080, 3100, 3101, 3102, 3103, 3110, 3120, 3130, 3131, 3140, 3150, 3160, 3168, 3170, 3180, 3191, 3195, 3215, 3220, 3225, 3230, 3261, 3266, 3301, 3350, 3400, 3500, 3530, 6021, 6022, 6212, 6230, 6231, 6243, 6250, 6260, 6311, 6312, 6313, 6315, 6350, 6360, 6415, 6510, 6520, 6530, 6540, 6560, 6563, 6570, 6821, 6831, 6838, 7380, 9000, 9006, 9007, 9040, 9075, 9140, 9163, 9180, 9181, 9183, 9184, 9185, 9187, 9250, 9252, 9253, 9254, 9265, 9280, 9920, 9911
Neutral (n = 200) 1080, 1122, 2393, 5390, 7019, 7092, 7950, 2394, 5395, 7020, 7095, 8502, 1202, 2396, 5410, 7021, 7096, 8503, 1240, 2397, 5455, 7023, 7100, 8510, 1301, 2410, 5500, 7025, 7110, 8531, 1302, 2411, 5510, 7026, 7130, 8540, 1303, 2435, 5520, 7030, 7135, 8600, 1321, 2440, 5530, 7031, 7136, 8620, 1333, 2458, 5531, 7032, 7137, 1670, 2480, 5532, 7033, 7140, 1675, 2484, 5533, 7034, 7150, 1903, 2485, 5534, 7035, 7160, 1908, 2487, 5535, 7036, 7161, 1930, 2488, 5731, 7037, 7165, 1931, 2489, 5661, 7038, 7170, 1932, 2495, 5970, 7039, 7175, 1935, 2514, 5971, 7040, 7179, 2100, 2516, 5972, 7041, 7180, 2101, 2518, 6000, 7042, 7182, 2102, 2570, 6010, 7043, 7183, 2104, 2575, 6150, 7044, 7184, 2107, 2579, 6840, 7045, 7185, 2190, 2580, 6900, 7046, 7186, 2200, 2595, 6930, 7050, 7187, 2206, 2597, 6940, 7052, 7188, 2210, 2620, 7000, 7053, 7190, 2211, 2630, 7001, 7054, 7192, 2214, 2635, 7002, 7055, 7211, 2215, 2690, 7003, 7056, 7224, 2221, 2692, 7004, 7057, 7233, 2230, 2694, 7006, 7058, 7234, 2270, 2695, 7009, 7059, 7235, 2271, 2749, 7010, 7060, 7236, 2272, 2752, 7011, 7061, 7237, 2273, 2810, 7012, 7062, 7242, 2280, 2830, 7013, 7077, 7247, 2377, 2850, 7014, 7078, 7248, 2381, 2870, 7016, 7080, 7249, 2382, 3210
IAPS = International Affective Picture System.

Experimental procedure

The experiment task was divided into four blocks of 12.11 ± 0.25 minutes. Each block consisted of 100 trials, including 25 positive, 25 negative, and 50 neutral visual stimuli. Five-minute resting periods were given between two blocks. Neutral pictures were always presented between emotional pictures, in order to avoid the effect of emotion induced by preceding stimulus. Fig. 1 shows the experimental task and the temporal structure of a single trial. The pictures were presented for 2,000 ms, which was set as the epoch of interest for the analysis. A fixation mark (‘+’) was presented for 1,000 ms before each stimulus. The subjects were instructed to determine whether they liked or disliked the visual stimulus as soon as possible, but to keep the intention of preference (like or dislike) for another 2,000 ms after the stimuli was extinguished while the fixation mark was displayed. Then, the subjects were to respond whether they ‘liked’ or ‘disliked’ by either ‘○’ or ‘×’ as shown in Fig. 1 as soon as possible within 2,000 ms. The location of ‘○’ and ‘×’ was randomized in order to minimize the prediction of the direction, and motor preparation.
Fig. 1

Experimental task.

jkms-34-e146-g001

EEG recording and preprocessing

EEGs were recorded at a sampling rate of 500 Hz using a 64 channel Ag/AgCl electrode cap (actiCAP; Brain Products, GmbH, Munich, Germany) according to the extended 10-20 system. The impedances of all electrodes were kept below 10k ohm. The reference and ground electrodes were placed at FCz and AFz, respectively. A bandpass filter (0.03–100 Hz) and 60 Hz notch filter was applied. EEGLAB was used for the preprocessing of brain potential.23 The single-trial waveforms were excluded from further analysis if they were severely contaminated by drift or transient artifacts due to head/electrode motion. Since we had the knowledge on the ground truth of valence of each visual stimulus, we further excluded the trials in which the subject's response was apparently incorrect. Each image in the International Affective Picture System (IAPS) has official normative rating on emotional condition. The rating can be considered to reflect normal emotional response (i.e., ground truth), and thus, each image can be classified into positive/negative/neutral states based on the rating. The subjects were asked to report whether they liked or disliked the stimuli. A trial was excluded from further analysis, if the response was not in accordance with the emotional state which was determined from the rating. For example, when a subject answered that he liked an apparently negative picture, we considered he showed abnormal emotional response due to some reason including abnormal personal preference, personal experience, or inattentiveness to the stimulus. The number of remaining trials was 89.05 ± 13.88, 88.37 ± 7.50, 187.63 ± 14.56 for positive, negative and neutral stimuli, respectively. Stereotyped artifacts such as eye movement or EMG were removed using independent component analysis (ICA).24 Subsequently, the EEGs were re-referenced according to the average reference.

Source localization

An open source MATLAB toolbox Brainstorm was used to calculate the cortical current source density on cortical surface.25 Boundary elements method was used for the forward problem. International Consortium for Brain Mapping (ICBM) 152 template was used as default anatomy.26 The head model was computed with a symmetric boundary element method (BEM) using OpenMEEG implemented in Brainstorm toolbox.27 The number of vertices in scalp, outer skull, inner skull layer were all set to 1922, and the conductivities of them were set to 1, 0.0125, 1 respectively. The thickness of skull was set to 4 mm. The current density at 15,002 points on cortical surface was calculated by solving the inverse problem with weighted minimum norm estimation.28 The cortical surface was homogeneously parcellated into 500 points using surface clustering implemented in Brainstorm toolbox,29 for the whole-brain analysis without prior knowledge. Finally, current density time-series on 500 cortical points were obtained.

Statistical analysis

Conventional analysis of event-related potential (ERP) utilizes prior knowledge of electrodes and time which are highly likely to show significant difference between emotional conditions. However, our purpose here is to find out the critical time and cortical region from the ERCD time-series itself, without using prior knowledge. This requires statistical comparisons of cortical current density at many points in time-cortex space, resulting in a multiple comparison problem involving a very large number of simultaneous comparisons. In our case here, there exist 250,000 (= 500 vertices × 500 time points) multiple comparisons. We adopted a nonparametric cluster-based permutation test17 to deal with this problem. As shown in Fig. 2A and B, this method tries to find a set of continuous spatiotemporal points which show significant changes in ERCD according to conditions, which is referred to as a ‘cluster.’17
Fig. 2

Illustration of the procedure for finding spatiotemporal regions correspoding to significant differences between conditions using nonparametric cluster-based permutation test. (A) Calculation of univariate test-statistics at all the points in time-vertex space. (B) Left: selected regions in time-vertex space with high test-statistics. If two points are continuous with respect to either time and vertex, they are grouped as a cluster as shown. Three clusters with P < 0.05 are shown, along with the sum of test-statistics within each cluster. Right: The clusters with high sum of test-statistics are determined based on the null distribution obtained from random permutation.

ERCD = event-related current density.
jkms-34-e146-g002
The detailed procedure is as follows: 1) ERCD averaged over all trials at all 500 cortical points, during −100 to 1,000 ms (550 time samples) are calculated; 2) Baseline correction of the averaged ERCD time-series is performed by subtracting average ERCD within −100 to 0 ms; 3) Statistical comparisons of three valence conditions are performed by one-way ANOVAs at 500 × 500 points in time-cortex space (500 temporal points, excluding 50 points within −100 to 0 ms baseline period); 4) The points with large F values, corresponding to P < 0.05, are selected; 5) The clusters of critical spatiotemporal points are defined by combining the points if two significant points are consecutive in time or within 30 mm in space17; 6) The ‘mass’ of a cluster is defined as the sum of F values within the cluster; 7) Surrogate data are obtained by random permutation of three conditions within each subject (5,000 times), and the null distribution of cluster mass is obtained by repeating steps 1)–6) above for the surrogate data; 8) The cluster masses found in step 6) are compared to the highest 5% of null distribution in step; 7) to determine whether they are significantly large, i.e., whether corresponding point corresponds shows significant difference between emotional conditions.
For the nonparametric cluster-based permutation test described above, the Mass Univariate Toolbox of Groppe et al.30 was modified to enable the ANOVA in addition to the t-test. The temporal epoch for the analysis was set to 400–800 ms, according to the earliest and latest time in the significant clusters determined as described above. The significant clusters were further parcellated to anatomical regions following the automated anatomical labeling (AAL) of Tzourio-Mazoyer et al.31 after taking time-average over the temporal epoch described above. The ERCDs of the vertices belonging to each parcel, i.e., each region of interest (ROI), were averaged to obtain ERCD time series for the parcel. Here the clusters were grouped to 6 ROIs (among 116 in the AAL database31) including bilateral central, cingulate, and inferior temporal areas.
Finally, two-way repeated-measures ANOVA was performed to analyze averaged ERCD amplitude over 400–800 ms of each region of interest. Within-subject factors included emotional conditions (3 levels) and ROIs (6 levels). Post-hoc t-test was performed to compare ERCDs between emotional conditions for each ROI. The P value was corrected by false discovery rate (FDR)32 method, proposed by Benjamini and Yekutieli.33 Statistical results of ROIs which showed significant ERCD differences among the conditions were displayed for simplicity.

Ethics statement

This study was approved by the Yonsei University Wonju Institutional Review Board (approval No. 2011-21). Written informed consent was obtained from each subject prior to the experiment.

RESULTS

Fig. 3A and B shows a scatter plot of the valence and arousal levels of all visual stimuli and statistical comparison of the ratings of valence and arousal levels among positive, negative, and neutral categories. Valence level was significantly different among the three categories (F [2,397] = 2,438.63; P < 0.001), and all the post-hoc pairwise comparisons between two categories were significantly (positive-negative, P < 0.001; positive-neutral, P < 0.001; negative-neutral, P < 0.001; Bonferroni corrected) as shown in Fig. 3B. Arousal levels were also significantly different among categories (F [2,397] = 263.58, P < 0.001). Post-hoc t-test showed that the arousal levels were not significantly different between the positive and negative categories (P = 0.33, Bonferroni corrected), whereas they were significantly higher for the positive/negative as compared to the neutral stimuli (positive-neutral, P < 0.001; negative-neutral, P < 0.001; Bonferroni corrected).
Fig. 3

Arousal and valence levels of emotional stimuli. (A) Distribution of arousal and valence levels of visual stimuli. (B) Statistical comparison of the valence and arousal level (***P < 0.001, Bonferroni corrected, independent t-test).

jkms-34-e146-g003
Fig. 4 shows the cortical regions showing significant ERCD differences among the three emotion conditions in 400-800 ms. Among the six ROIs determined by the cluster-based permutation test, only two ROIs showing statistical difference between categories are presented in Fig. 4 for simplicity (left PCC [green] and right IT [blue]). Significant main effects of ROI (F [5,90] = 2.719; P = 0.025) and emotional category (F [2,36] = 7.977; P = 0.010) were found by repeated-measures ANOVA, and the interaction between the two factors was also statistically significant (F [10,180] = 2.261; P = 0.016).
Fig. 4

Cortical regions showing significant event-related current density differences between the three emotion conditions. Among the six region of interests which were determined by the cluster-based permutation test, only two are displayed for simplicity (left PCC [green] and right ITC [blue]).

PCC = posterior cingulate cortex, ITC = inferior temporal cortex.
jkms-34-e146-g004
Significant changes of ERCD between emotional categories were found only in the two ROIs presented in Fig. 4 (left PCC and right IT). In the left PCC, both positive and negative stimuli showed more negative ERCD compared to the neutral ones (Fig. 5A). The ERCD for the positive was significantly more negative than that for the neutral (t [18] = −2.936; P = 0.013; FDR corrected), and that for the negative was also significantly more negative than that for the neutral (t [18] = −3.870; P = 0.003; FDR corrected). However, it was not significantly different between the positive and negative categories (t [18] = 1.836; P = 0.083; FDR corrected).
Fig. 5

Spatiotemporal characteristics of the two ROIs (left PCC and right ITC). (A) The time-series of the ERCD at the left PCC and its statistical comaprison among emotional categories. (B) The time-series of the ERCD at the right ITC and its statistical comaprison among emotional categories. Error bars denote standard errors.

ERCD = event-related current density, PCC = posterior cingulate cortex, ROI = region of interest, ITC = inferior temporal cortex.
*P < 0.05; **P < 0.01; pairwise t-test, FDR corrected.
jkms-34-e146-g005
In the right IT, it was remarkable that the ERCD was significantly more negative for the negative compared to the other two categories (Negative-positive: t [18] = −2.545; P = 0.030; FDR corrected. Negative-neutral: t [18] = −3.096; P = 0.018; FDR corrected) (Fig. 5B), whereas it was not significantly different between the positive and neutral categories (t [18] = −1.488; P = 1.000; FDR corrected).

DISCUSSION

In this study, cortical information processing of emotional visual stimuli was investigated using distributed source analysis of multichannel event-related EEG. Overall information processing includes visual pattern analysis as well as emotional analysis, and we expected that the valence and arousal would have different effects on each of these two steps. The most noticeable differences between emotional categories were found at 400−800 ms interval in posterior cingulate and inferior temporal cortices. The former and the latter were predominantly affected by arousal and valence, respectively. We found that arousal has strong effect on episodic memory encoding. As for the valence, only the negative one seems to have a large influence on cortical activities in visual cortical area. The anatomical locations of the neural substrates of emotional visual stimulus processing were determined by EEG source imaging, which has inherent limitation in spatial resolution.28 However, our results are in accordance with current knowledge on functional neuroanatomy.343536
According to previous ERP studies on emotional visual stimuli processing, the interpretation of the meaning of stimuli occurs after 400 ms, especially for the encoding of episodic memory on motivationally relevant stimuli.13 Novel stimuli are quickly and automatically memorized without efforts, which is important characteristic of episodic memory. Cognitive process of episodic memory embraces encoding, consolidation, storage, and retrieval. For the encoding, new information is combined with previous memories, and thus, it is expected that recollective interpretation of incoming visual stimuli at 400−800 ms is closely related to the memory encoding.
The difference in cortical activities according to arousal level was observed predominantly at 400−800 ms in PCC. Considering the functional role of PCC, the result suggests that arousal influences automatic, unintended memory encoding of arousing visual stimuli. Previous studies have shown that the PCC is activated during episodic memory retrieval,34 and, is involved in both memory encoding and retrieval, along with precuneus, posterior inferior parietal lobule. These regions together are suggested as a parietal memory network.18 An fMRI study on visual presentation of emotional words showed that left PCC is selectively activated by arousing stimuli, and not affected by valence level,35 in accordance with our results.
The activities in right inferior temporal cortex at 400−800 ms epoch in response to the stimuli with negative valence are expected to be due to the evaluation of the risk associated with the negative-valence stimuli.37 It is interesting that the activities of the visual area at this later period, which seems to be after the end of earlier visual pattern analysis, are increased for the negative stimuli. The IT cortex belongs to the ventral stream of visual information processing which is involved within recognizing patterns, faces, and objects.36 The sensitivity of the IT on negative stimuli may also be due to its connectivity with amygdala,38 which is a part of cortical circuits for the negative stimuli processing.39
In conclusion, we found that arousal has strong effect on episodic memory encoding, and that only negative valence seems to have large influence on cortical activities for the visual analysis, at relatively late epoch (400−800 ms). These results may provide valuable information for understanding the changes of cortical function according to neuropsychiatric disorders.

Notes

Funding This research was supported by a grant (18CTAP-C129722-02) from Technology Advancement Research Program (TARP) funded by Ministry of Land, Infrastructure and Transport of Korean government. This research was supported by the Brain Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (2017M3C7A1029485).

Disclosure The authors have no potential conflicts of interest to disclose.

Author Contributions

  • Conceptualization: Choi JW, Cha KS, Kim KH.

  • Formal analysis: Yeo D, Her S, Kim H.

  • Investigation: Choi JW, Yeo D, Kim KH.

  • Methodology: Yeo D, Kim H, Her S, Choi JW, Cha KS, Kim KH.

  • Resources: Choi JW, Cha KS, Kim KH.

  • Software: Yeo D.

  • Supervision: Kim KH.

  • Validation: Choi JW, Cha KS, Kim KH.

  • Visualization: Yeo D.

  • Writing - original draft: Yeo D, Kim KH.

  • Writing - review & editing: Kim KH, Yeo D, Kim H, Her S.

References

1. Posner J, Russell JA, Peterson BS. The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol. 2005; 17(3):715–734.
crossref
2. Lane RD, Reiman EM, Bradley MM, Lang PJ, Ahern GL, Davidson RJ, et al. Neuroanatomical correlates of pleasant and unpleasant emotion. Neuropsychologia. 1997; 35(11):1437–1444.
crossref
3. Huang YX, Luo YJ. Temporal course of emotional negativity bias: an ERP study. Neurosci Lett. 2006; 398(1-2):91–96.
crossref
4. Güntekin B, Başar E. A review of brain oscillations in perception of faces and emotional pictures. Neuropsychologia. 2014; 58:33–51.
crossref
5. Sohaib AT, Qureshi S, Hagelbäck J, Hilborn O, Jerčić P. Evaluating classifiers for emotion recognition using EEG. In : Schmorrow DD, Fidopiastis CM, editors. Foundations of Augmented Cognition. Berlin: Springer;2013. p. 492–501.
6. Phan KL, Wager T, Taylor SF, Liberzon I. Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage. 2002; 16(2):331–348.
crossref
7. Schupp HT, Junghöfer M, Weike AI, Hamm AO. Emotional facilitation of sensory processing in the visual cortex. Psychol Sci. 2003; 14(1):7–13.
crossref
8. Liu Y, Huang H, McGinnis-Deweese M, Keil A, Ding M. Neural substrate of the late positive potential in emotional processing. J Neurosci. 2012; 32(42):14563–14572.
crossref
9. Matsumoto A, Ichikawa Y, Kanayama N, Ohira H, Iidaka T. Gamma band activity and its synchronization reflect the dysfunctional emotional processing in alexithymic persons. Psychophysiology. 2006; 43(6):533–540.
crossref
10. Oliver LD, Mitchell DG, Dziobek I, MacKinley J, Coleman K, Rankin KP, et al. Parsing cognitive and emotional empathy deficits for negative and positive stimuli in frontotemporal dementia. Neuropsychologia. 2015; 67:14–26.
crossref
11. Jung W, Park DH, Yu JH, Ryu SH, Ha JH, Shin BH. The change of cortical activity induced by visual disgust stimulus. Sleep Med Psychophysiol. 2013; 20(2):75–81.
crossref
12. Carretié L, Hinojosa JA, Martín-Loeches M, Mercado F, Tapia M. Automatic attention to emotional stimuli: neural correlates. Hum Brain Mapp. 2004; 22(4):290–299.
crossref
13. Olofsson JK, Nordin S, Sequeira H, Polich J. Affective picture processing: an integrative review of ERP findings. Biol Psychol. 2008; 77(3):247–265.
crossref
14. Zhu C, He W, Qi Z, Wang L, Song D, Zhan L, et al. The time course of emotional picture processing: an event-related potential study using a rapid serial visual presentation paradigm. Front Psychol. 2015; 6:954.
crossref
15. Frühholz S, Fehr T, Herrmann M. Early and late temporo-spatial effects of contextual interference during perception of facial affect. Int J Psychophysiol. 2009; 74(1):1–13.
crossref
16. Kim HD, Sim KB. Brain-wave analysis using fMRI, TRS and EEG for human emotion recognition. J Korean Inst Intell Syst. 2007; 17(6):832–837.
crossref
17. Maris E, Oostenveld R. Nonparametric statistical testing of EEG- and MEG-data. J Neurosci Methods. 2007; 164(1):177–190.
crossref
18. Gilmore AW, Nelson SM, McDermott KB. A parietal memory network revealed by multiple MRI methods. Trends Cogn Sci. 2015; 19(9):534–543.
crossref
19. Kensinger EA. Remembering emotional experiences: the contribution of valence and arousal. Rev Neurosci. 2004; 15(4):241–251.
crossref
20. Vuilleumier P, Driver J. Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions. Philos Trans R Soc Lond B Biol Sci. 2007; 362(1481):837–855.
crossref
21. Kemp AH, Silberstein RB, Armstrong SM, Nathan PJ. Gender differences in the cortical electrophysiological processing of visual emotional stimuli. Neuroimage. 2004; 21(2):632–646.
crossref
22. Lang PJ, Bradley MM, Cuthbert BN. International Affective Picture System (IAPS): Technical Manual and Affective Ratings. Gainesville, FL: National Institute of Mental Health Center for the Study of Emotion and Attention;1997.
23. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004; 134(1):9–21.
crossref
24. Jung TP, Makeig S, Humphries C, Lee TW, McKeown MJ, Iragui V, et al. Removing electroencephalographic artifacts by blind source separation. Psychophysiology. 2000; 37(2):163–178.
crossref
25. Tadel F, Baillet S, Mosher JC, Pantazis D, Leahy RM. Brainstorm: a user-friendly application for MEG/EEG analysis. Comput Intell Neurosci. 2011; 2011:879716.
crossref
26. Fonov V, Evans AC, Botteron K, Almli CR, McKinstry RC, Collins DL, et al. Unbiased average age-appropriate atlases for pediatric studies. Neuroimage. 2011; 54(1):313–327.
crossref
27. Gramfort A, Papadopoulo T, Olivi E, Clerc M. OpenMEEG: opensource software for quasistatic bioelectromagnetics. Biomed Eng Online. 2010; 9(1):45.
crossref
28. Grech R, Cassar T, Muscat J, Camilleri KP, Fabri SG, Zervakis M, et al. Review on solving the inverse problem in EEG source analysis. J Neuroeng Rehabil. 2008; 5(1):25.
crossref
29. Balderston NL, Schultz DH, Baillet S, Helmstetter FJ. Rapid amygdala responses during trace fear conditioning without awareness. PLoS One. 2014; 9(5):e96803.
crossref
30. Groppe DM, Urbach TP, Kutas M. Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. Psychophysiology. 2011; 48(12):1711–1725.
crossref
31. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. 2002; 15(1):273–289.
crossref
32. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B. 1995; 57(1):289–300.
crossref
33. Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Stat. 2001; 29(4):1165–1188.
crossref
34. Maddock RJ, Garrett AS, Buonocore MH. Remembering familiar people: the posterior cingulate cortex and autobiographical memory retrieval. Neuroscience. 2001; 104(3):667–676.
crossref
35. Maddock RJ, Garrett AS, Buonocore MH. Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task. Hum Brain Mapp. 2003; 18(1):30–41.
crossref
36. Mishkin M, Ungerleider LG. Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behav Brain Res. 1982; 6(1):57–77.
crossref
37. Carretié L, Albert J, López-Martín S, Tapia M. Negative brain: an integrative review on the neural processes activated by unpleasant stimuli. Int J Psychophysiol. 2009; 71(1):57–63.
crossref
38. Shi C, Davis M. Visual pathways involved in fear conditioning measured with fear-potentiated startle: behavioral and anatomic studies. J Neurosci. 2001; 21(24):9844–9855.
crossref
39. LeDoux JE. Emotion circuits in the brain. Annu Rev Neurosci. 2000; 23(1):155–184.
crossref
TOOLS
ORCID iDs

Donghoon Yeo
https://orcid.org/0000-0002-4586-9282

Hyun Kim
https://orcid.org/0000-0002-7265-8640

Seongjin Her
https://orcid.org/0000-0002-5817-2206

Jeong Woo Choi
https://orcid.org/0000-0001-5824-8859

Kwang Su Cha
https://orcid.org/0000-0002-7710-8648

Kyung Hwan Kim
https://orcid.org/0000-0001-9044-0437

Similar articles