{"id":101,"date":"2016-09-28T14:10:19","date_gmt":"2016-09-28T12:10:19","guid":{"rendered":"http:\/\/thomaskosch.com\/?p=101"},"modified":"2016-09-28T14:37:20","modified_gmt":"2016-09-28T12:37:20","slug":"visualizing-real-time-brain-localization-in-3d","status":"publish","type":"post","link":"https:\/\/thomaskosch.com\/index.php\/2016\/09\/28\/visualizing-real-time-brain-localization-in-3d\/","title":{"rendered":"Visualizing Real-Time Brain Localization in 3D"},"content":{"rendered":"<figure id=\"attachment_104\" aria-describedby=\"caption-attachment-104\" style=\"width: 232px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-104\" src=\"http:\/\/thomaskosch.com\/wp-content\/uploads\/2016\/09\/10-20-system.png\" alt=\"10-20 electrode placement system\" width=\"232\" height=\"225\" \/><figcaption id=\"caption-attachment-104\" class=\"wp-caption-text\">Figure 1: 10-20 electrode placement system [4].<\/figcaption><\/figure>\n<p style=\"text-align: justify;\">Recently, measuring brain activity (known as electroencephalography, short EEG) to enhance or analyze\u00a0the experience\u00a0of user interfaces has attracted great attention. Besides of medical applications, several researchers have investigated effort\u00a0to make use of it in the area of human-computer interaction, resulting in several projects and publications ([1, 2, 3], just to name a few).\u00a0To measure brain\u00a0activity at a specific\u00a0spot on a head, an electrode is\u00a0attached to that place. Measurement reveal a voltage, showing\u00a0the difference between the measured voltage on the head and a reference electrode. The reference electrode is placed on an arbitrary place on the body (usually the ear lobe) and is necessary to calculate the voltage drop between measurements received from the electrode and the reference electrode. Electrode spots are also denoted with unique names and usually follow a system (see Figure 1).<\/p>\n<figure id=\"attachment_121\" aria-describedby=\"caption-attachment-121\" style=\"width: 143px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-121\" src=\"http:\/\/thomaskosch.com\/wp-content\/uploads\/2016\/09\/ultracortex.png\" alt=\"3D printed Ultracortex headset\" width=\"143\" height=\"125\" \/><figcaption id=\"caption-attachment-121\" class=\"wp-caption-text\">Figure 2: 3D printed Ultracortex headset.<\/figcaption><\/figure>\n<p style=\"text-align: justify;\">This gives us solely measured brain activity at certain spots, but does not reveal the localization of the generated electrical source. Several algorithms exist which solve this problem. One famous algorithm is the sLORETA algorithm [5], which\u00a0accepts the measured voltages\u00a0from electrodes and calculates source localization dependent on the chosen model. Knowing\u00a0the source of measured voltages can be used to track diseases such as Alzheimer, ADHS, or origins of depressions.<\/p>\n<p style=\"text-align: justify;\">During a research project [6], the sLORETA algorithm\u00a0was implemented using an interactive 3D voxel-based visualization to make brain source localization visible. We used a heatmap-like visualization to make it understandable as possible.\u00a0After running simulations of electrical activity and comparing these to our algorithm, we\u00a0are able to verify the correctness of our implementation. The computation\u00a0delivers a magnitude for each voxel, being responsible to visualize the electrical strength using a\u00a0color code.<\/p>\n<p>We used an 16 channel OpenBCI [7]\u00a0together with an Ultracortex headset (see Figure 2) to run a pilot study in the wild while delivering stimuli in virtual reality. Implementation and visualization was integrated into the neuromore Studio platform [8], which provides support for recording EEG data and signal processing for post hoc analysis purposes. Results\u00a0showed a working visualization to see where brain activity is generated.\u00a0Red-colored areas show a high probability, that this area is responsible for measured voltages at different electrodes. However, blue areas denote a low probability. Changes in brain activation can be observed in real-time, making it easier to find responsible brain areas for certain input stimuli:<\/p>\n<div style=\"width: 1140px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-101-1\" width=\"1140\" height=\"641\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"http:\/\/thomaskosch.com\/wp-content\/uploads\/2016\/09\/loreta.mp4?_=1\" \/><a href=\"http:\/\/thomaskosch.com\/wp-content\/uploads\/2016\/09\/loreta.mp4\">http:\/\/thomaskosch.com\/wp-content\/uploads\/2016\/09\/loreta.mp4<\/a><\/video><\/div>\n<p style=\"text-align: justify;\">\n<p style=\"text-align: justify;\">Of course, visualizing brain source localization is not the almighty solution to understand the brain completely. First, our implementation does not provide a high density resolution since it this highly depends on the computation power. Furthermore,\u00a0results depend highly on the chosen head model. For our experiment, we have chosen a spherical head model due to its simplicity, but in reality this could lead to false results [8]. Additionally, controlled\u00a0EEG experiments are elaborate to set up, which makes it hard as usage for end user purposes.\u00a0Our implementation aimed for a proof-of-concept solution. When looking at the current\u00a0development of consumer EEG devices in the consumer market, promising advances of visualizing brain source localization for consumers are looming ahead.<\/p>\n<p style=\"text-align: justify;\">Acknowledgments go to Benjamin Jillich, Manuel Jerger and Patrick Hilsbos for providing neuromore Studio as base platform. We thank Dr. Ashley E. Stewart, Dr. Deborah C. Mash and Matthew Seely for their input regarding the pilot study.<\/p>\n<p>References:<br \/>\n[1]\u00a0Frey, J., Daniel, M., Castet, J., Hachet, M., &amp; Lotte, F. (2016). Framework for Electroencephalography-based Evaluation of User Experience.<br \/>\n[2]\u00a0McMahan, T., Parberry, I., &amp; Parsons, T. D. (2015). Modality specific assessment of video game player\u2019s experience using the Emotiv.<i>Entertainment Computing<\/i>, <i>7<\/i>, 1-6.<br \/>\n[3]\u00a0Wolpaw, J. R., McFarland, D. J., Neat, G. W., &amp; Forneris, C. A. (1991). An EEG-based brain-computer interface for cursor control.<i>Electroencephalography and clinical neurophysiology<\/i>, <i>78<\/i>(3), 252-259.<br \/>\n[4]\u00a0<a href=\"https:\/\/www.trans-cranial.com\/local\/manuals\/10_20_pos_man_v1_0_pdf.pdf\">https:\/\/www.trans-cranial.com\/local\/manuals\/10_20_pos_man_v1_0_pdf.pdf<br \/>\n<\/a>[5]\u00a0Pascual-Marqui, R. D. (2002). Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. <i>Methods Find Exp Clin Pharmacol.<\/i><br \/>\n[6]\u00a0Kosch, T., Hassib, M., &amp; Schmidt, A. (2016, May). The Brain Matters: A 3D Real-Time Visualization to Examine Brain Source Activation Leveraging Neurofeedback. In <i>Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems<\/i> (pp. 1570-1576). ACM.<br \/>\n[7]\u00a0<a href=\"http:\/\/openbci.com\">http:\/\/openbci.com<br \/>\n<\/a>[8] <a href=\"http:\/\/www.neuromore.com\/\">http:\/\/www.neuromore.com\/<\/a><br \/>\n[9]\u00a0<a href=\"http:\/\/www.sciencealert.com\/a-man-who-lives-without-90-of-his-brain-is-challenging-our-understanding-of-consciousness\">http:\/\/www.sciencealert.com\/a-man-who-lives-without-90-of-his-brain-is-challenging-our-understanding-of-consciousness<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, measuring brain activity (known as electroencephalography, short EEG) to enhance or analyze\u00a0the experience\u00a0of user interfaces has attracted great attention. Besides of medical applications, several researchers have investigated effort\u00a0to make use of it in the area of human-computer interaction, resulting in several projects and publications ([1, 2, 3], just to name a few).\u00a0To measure brain\u00a0activity [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-101","post","type-post","status-publish","format-standard","category-uncategorized","czr-hentry"],"_links":{"self":[{"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/posts\/101","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/comments?post=101"}],"version-history":[{"count":27,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/posts\/101\/revisions"}],"predecessor-version":[{"id":132,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/posts\/101\/revisions\/132"}],"wp:attachment":[{"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/media?parent=101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/categories?post=101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thomaskosch.com\/index.php\/wp-json\/wp\/v2\/tags?post=101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}