Saturday, December 29, 2012

dinner aura

(this and the previous post were written as dated, but are posted today, 1-5-13; the times are today's time).

last night, just as we were starting our saturday night banquet, i noticed that everything i was looking at seemed distorted, and then realized that a scotoma was developing, just below and right of fixation. i wasn't able to pay much attention to this one, since i had to eat dinner without looking like a lunatic, but it seemed normal; straightish out to the right of fixation, then arcing downward. there was a period early on where the scotoma was very difficult to find, but i think it was just distributed, or at least not exactly the same in both eyes, but was still there. whereas usually the headache would have started about halfway in, this time there was nothing; maybe a slight sense of headache-like pressure behind the forehead, but no pain. i am guessing this was maybe due to the constant alcohol ingestion? by the time the 10-15 minute mark came around, i had probably had at least 2 shots of baijiu.

absence of a headache was good, since following this i went with jp's father, uncle huang, and uncle wang to get my 'feet washed', which really turned out to mean a full-body massage. a full-body massage while fully dressed in winter getup, sweaters and pants and long underwear. it was nice, though! and lucky no headache, since there was a stage of head-beating.

also, i didn't detect any sort of prodrome. in the morning, i had felt it inordinately difficult to form sentences, and made some strange mistakes in chinese, producing strangely wrong words, which i noticed at the time as out of the ordinary. otherwise, nothing obviously in prediction..

Thursday, December 27, 2012

random observations:

(rambling chinese vacation edition):

1. due to jet lag, woke up at about 5:30am yesterday, lay in bed for ~1.5hrs. of course a thousand random thoughts ran through my head, but for a while a lay there watching the augenlicht. long, long ago i noticed how it cycles: against the dark, reddish-black background, a brighter cloud coalesces around the fovea, then fades, then coalesces again. the cycle is somewhere between 5-10 seconds, the cloud is a very low-frequency modulation (maybe ~5degrees across) of the high-frequency noise grain.

what i noticed yesterday was that as the cloud fades, some parts of it seem to 'stick'; this is hard to describe. imagine that the cloud was displayed on a screen, and that its brightest parts, around the peak, were 'clipped'; then, as the could fades, the clipped parts persist, then brighten noticeably, then dissipate as the cycle continues. the impression is similar to a very bright afterimage floating in front of a fixated object, except that my eyes were closed, and i was certainly dark adapted. the clipped portions are sharp-edged, small (half or a quarter degree across), with the spatial appearance of little interconnected droplets of a liquid. i wasn't able to tell if they had the same structure on each cycle, but it seemed that they did.

i cannot guess meaningfully what this is. some sort of pattern formation machinery being stimulated by the structure of the cloud cycle, which has a slower decay constant? it seems familiar, so i might have noticed it at some other time in the past when i found myself lying in bed, unable to go to sleep. when i was in college, that happened a lot, because i would have classes in the morning and force myself to bed, despite wanting to stay up until 2 or 3, and so i'd lay in bed for hours sometimes, waiting to sleep.

i also noticed that i could very clearly see the 'eye crank lines', especially when looking down, whereas usually i can't see them when my eyes are closed.

2. when we finally got out of bed yesterday morning, discovered it was snowing. it eventually stopped snowing and started raining, so the weather yesterday was miserable. still, we drove down south to visit family. we went to visit j*'s father's older sister, who i'd never met before, in a village in another corner of fanchang; her home was like something out of a fairy tale, not so surrounded by garbage and chaos like some of the other villages (which are still nice to visit, don't get me wrong). i had jingping take some pictures. there was a mountain running up directly on the side of the village, with a bamboo forest; spread out away from the mountain and the village was a large expanse of vegetable gardens. we had lunch cooked on a wood stove (and with some electricity). i hope that china is able to keep from totally losing this world as it moves on into the future.. all they really need is to find a way to deal with the garbage.

on the way down there, we drove on a new highway which took us through several tunnels beneath the mountains. at some point, to the right, in the distance, maybe a mile or so distant (in the south of wuhu, there are mountains and there are flat plains, and stark, sudden transitionsn between them), through the snowy, rainy, smoggy haze, i saw a massive building, seemingly in the middle of nowhere. it looked like something in DC; the size of the pentagon, ten or twenty stories wide, sixty stories wide. then, a little further south, a gigantic factory or processing plant, like a refinery or the biggest concrete plant you've ever seen. then, a mountain. i didn't bring the GPS to track where we went this time, but i can probably figure it out from memory. this reminds me of last year, something i never wrote down; on the bus back to shanghai, in the distance i could see a glowing tower, probably a hotel, surrounded by nothing else. it was probably fifty stories high, and surrounded by what looked like a 4th or 5th-tier town. maybe we'll see it again this time, since we're probably taking the same bus back.

also on the wuhu note, i've noticed lots of songbirds here in the subdivision, first time in four winters. maybe whatever drove them away is getting better?

3. dinner at uncle's restaurant. dog meat tastes weird. it was worth a try.

4. still on the roman history kick, been reading Tacitus' history of the 'year of four emperors', on the civil war that commenced with the death of Nero. it really is great reading. in the section on Otho's last stand and suicide, i paused for a while and thought about how all this had happened. i still don't know much about roman history, but i've read livy, so i know something about the beginnings of the republic and how it came to be; and i've read plutarch's lives of marius, sulla, crassus, pompey, and caesar, so i kind of understand how the republic cascaded into the empire.

i thought, the romans had all these lawful institutions for separating power, trading offices more-or-less peacefully and agreeably, avoiding autocracy and civil wars. they kept this up for hundreds of years, but only because to have faltered would have probably meant the end of rome, because there were still so many other powerful players in the vicinity. only after those players - the etruscans, the gauls, carthage - were subjugated, only then could the internal struggles really commence. the rise of the emperors, through the disruptions of marius to caesar, put an end to those struggles by ending all the power sharing. but that meant that once an emperor had failed, the struggles would flare again, and there would be civil war. the situation described - and witnessed first-hand - by Tacitus was the first of several times that this would happen, and it would eventually bring the end of the empire.

so i thought all of that, putting together the pieces that so many others have put together so many times, and then i turned the page, and Tacitus himself begins a digression where he outlines the same reflections on the same reasoning, and again i was impressed at the immediacy of reading the thoughts of a person who lived and died more than 1800 years ago.

5. despite the preceding item on how great Tacitus is, i switched yesterday (at the beginning of the next book of Tacitus, on Vespasian's rebellion) to reading Darwin's 'on expressions of man and animals', or whatever the title is. i've wanted to read this for years, never got around to it until there it was, Free on Ibooks. reading Darwin is great because of the way he makes his thinking so transparent; he explains everything iteratively, first in broad terms, then more and more specific, each time tacking on anecdotes or examples with more and more density. origin of species and the descent of man were written similarly, spiraling down from general statements to specific demonstrations, with examples at every level, but there was less anecdote; here, Darwin is on every page noting a story from some friend or acquaintance, or describing the behavior of his own dogs or farm animals. so, the story is solidy anecdotal, but still convincing, because you can see how he is being led at each stage to a question; if such-and-such is true, we should observe this, and here is an example that we all know, or an anecdote that i'm sure you'll recognize (e.g. how a dog acts when in anticipation of something he likes).

i also like all the talk about "nerve-force". the idea that this nerve-force overflows from the channels of immediate use, into channels of frequent or necessarily convenient use, and only later into less frequently used channels, is important in a lot of his examples. also, his 'principle of antithesis' in explaining some expressions is, i think, an interesting example of something more general than an adaptation aftereffect. for example, the excited dog, when it finds that it will not get what it expects, will look dejected - the 'hot-house face' - with this expression explained as, essentially, the aftereffect of adaptation to an excited manner. i think i will look more into this idea of antithesis in behavior..

Saturday, December 22, 2012

words

trying, trying, to get to a black belt in tkd. it's hard, because i am not good at tkd. i have no athletic talent whatsoever, but i try anyways. sometimes it goes well.

so i keep hurting my back over the years, and for the most part it's been less frequent in the past 3, what with the regular exercise. however, i hurt it badly, permanently, last year, after *resting* for a month. not resting actually, but working on a grant proposal, doing nothing but sitting/slouching and reading/writing.

so then, lately, i decided to start doing the sunday afternoon core training class, which is basically variations on sit-ups that you do in rounds, over and over again. it's good. i did it this sunday. the day before, i went to the grocery store, and forgot that we were almost out of rice, so i didn't buy any.

monday night we ate the last of the rice, so tuesday night, on the way home, i went by the grocery and bought two bags, because if you buy two you get a discount. then i went home. this was all on foot or by train. with two 15 pound bags of rice. i didn't perceive a problem.

wednesday night i reached out to lift up the toilet seat, and something in my upper back exploded. so no more tkd for the rest of the week, and it hurt a lot. it's mostly better now, hurts, but i'm not partially immobilized anymore. thursday and friday, along with the back pain, my right arm hurt and my hand was numb. so i'm suspicious that the damage wasn't just to a muscle, but to some part of the spinal machinery, although if so maybe it shouldn't be improving so fast.

i wrote a facebook poem about it:

people who stand
on escalators
cervical spinal nerve eight
the north wind
on cambridge street


in other news, i'm like most americans, preoccupied with guns lately. i don't think anybody has a right to have one, that sums up my opinion. oh well.

going to china tomorrow morning! that will be nice, except i have work to do that i'm not interested in doing but have to do anyways. should be alright.

**
also, this came out a few days ago, didn't know where to put it, it's pretty ordinary:

undirected urges
to assemble words
vaguely resembling
the task at hand

sitting quietly
struggling silently
ignoring tomorrow
avoiding time

congealing thoughts
pooling together
into my hands
out of my mouth

watch and wait
the page to complete
vaguely resembling
the task at hand

Wednesday, December 12, 2012

red boots

m* is visiting the lab, sitting behind me at the desk where p* used to sit. he's leaving friday. i've had several talks with him about methods relating to the blur adaptation studies, and he's really helpful in clarifying certain issues. he's always solidly skeptical.

he has a whole foods paper bag under his desk, i think it's filled with bottles of beer. when you come in the door to the office, if he's sitting there at the desk, you see his back, and the red and brown paper bag sitting on the floor right next to his feet. yesterday, several times, i came in the door and thought immediately i saw him sitting there wearing red cowboy boots, only to realize what i was really seeing. deja trompé!

Monday, December 10, 2012

bo xilai rides my train

Bo Xilai rides my train. He's usually there when I get on at Reservoir on the 9:45. He always has a seat in the rear car, where I ride in the morning. He sits facing the rear, which I figure he does so that fewer people have a chance to recognize him. A lot of Chinese people ride the D train, but I've never noticed anyone seeming to recognize him. Maybe they do and just ignore him.

He wears Nikes and blue jeans. He doesn't look wealthy or powerful. Sometimes I see him reading a Chinese newspaper, but usually he's just sitting there looking around kind of nervously, or napping with his eyes closed. He rides to the Chinatown stop and gets off. His son went to graduate school at Harvard, so he must have some connections to some Chinese people in town.

But still, why is Bo Xilai riding the train in Boston? Isn't he afraid of being recognized, especially in Chinatown? He's supposed to be under house arrest in China, not riding around on public transit in America. He can't assume that everyone will be friendly and understanding. You'd think it would be excellent tabloid material: "Bo Xilai Escapes to Boston". And what's he doing in Chinatown? Maybe he has a job in a store or a restaurant to pass the time, trying to start a new life, or maybe he's going to some kind of a meeting of exiles.

He always looks a little confused and uncomfortable. I feel like everything isn't right with him. Maybe he's homesick? I saw the pictures of his wife in the docket. Does he think she really did what they say she did? I wonder if she's here too, in Boston. I haven't seen her. Maybe he's just lonely. Maybe he doesn't know anyone here, and he goes to Chinatown to remind himself of China.

I wonder what will happen when it's time for Bo Xilai's trial. Will they use a look-alike? Maybe they'll cancel it, or hold it in secret. Maybe they'll announce that he's died. I can't believe that they'll announce that he's escaped. We'll see what happens - it will all be in the news. I won't tell anyone what I know, though, whatever happens. If Bo Xilai wants to stay in Boston and ride the D-Train, it's really none of my business.

Monday, December 03, 2012

train headache

slightly excruciating headache. developed on the train. may or may not be migraine, it's a fuzzy cloud of pain centered between behind my eyes and my palate. maybe a sinus thing instead, or maybe there's an interaction with the winter air and the train heating. nauseated and photophobic. i keep holding my breath.

Sunday, December 02, 2012

visual phenomena at the two edges of sleep

1. going to sleep last night, and saw that high t.f. flicker, though i didn't have a headache at the time. actually, haven't had one in almost 2 months, i think. woke up this morning feeling like i had a hangover, but no headache per se, so maybe i had a migraine in my sleep? or, it was an overdose on thai food. there were definitely abdominal repercussions.

2. been meaning to write this down: jingping usually gets up before me what with the school and all, and usually when she gets up to leave it's still dark. if she turns on the bedroom light and i'm sufficiently conscious but still with eyes closed (and maybe also if my face is pointing in the right direction), i will see a quick red flash. nothing interesting, right? but the flash has a geometric structure, a hexagonal lattice, like an M-scaled honeycomb. a typical sort of visual field hallucination, but i only started noticing it in recent months.

that is all.

Monday, November 26, 2012

blur or no blur?

Some notes on the aftereffects of a paper revision I just submitted (not coincidentally linked to the rambling at the end of the previous entry):

The big problem I have left over after the last revision of the blur adapt paper is this: does it mean anything? I've wound up half convinced that while I have a good explanation for a complex and strange phenomenon, it may be seen as boiling down just to a measurement, by visual system proxy, of the stimuli themselves. That is, all the stuff about selectivity, slope changing, symmetry of adaptation, etc., might all just be a figment of the wholly unnatural way of blurring/sharpening images that we've used.

What's left? The method is good. There are also questions about the spatial selectivity of the phenomenon, and, most importantly I think, about its timecourse. If blur adaptation is something real and not just a spandrel interaction between contrast adaptation and strange stimuli, it doesn't make a lot of sense that it would manifest in everyone in the same way unless it did have some sort of perceptual utility. The utility that exists is a good question. Let's make a list:

1. Changes in fixation across depths. Most of the people who do these experiments are young and have good accommodation. Blur is one of the things that helps to drive accommodation, to the point where if everything is working correctly, within a few hundred (less?) milliseconds of changing fixation in depth, the image should be focused. So, blur adaptation would not be useful in this situation. Maybe it's useful when you're older, and for this reason it sits there, functional and in wait, for the lens to freeze up? Seems unlikely and implausible, but possible. When you get old, and look at different depths, the sharpness of the image will change, and it would be nice to have some dynamic means of clawing back whatever high s.f. contrasts might still be recoverable in a blurred image.

2. This begs the question of how much can be recovered from an image blurred locally. That is, the slope-change method is basically using an image-sized psf, which is what makes it so weird. Blur doesn't usually occur this way, instead it occurs by a spatially local psf applied to the image, like a gaussian filter. If an image is gaussian blurred, how much can it be sharpened?

3. Viewing through diffusive media, like gooey corneas or fog or rain, or muddy water. The latter phenomena, if I'm not mistaken, affect contrast at all frequencies, while stuff-in-the-eyes effects optical blur, i.e. more attenuation at high than at low frequencies. It would be nice to know, in detail, what types of blur or contrast reduction (it might be nice to reserve 'blur' for the familiar sense of high s.f. reduction) occur ecologically. We also have dark adaptation, where the image is sampled at a lower rate but is also noisier. The noise is effectively a physical part of the retinal image (photon, photochemical, neural), meaning that it's local like an optical defect and not diffusive like fog. Maybe blur adaptation is mostly good for night vision?

4. Television. CRTs. Maybe we're all adapted, long-term and dynamically, to blurred media. All captured and reproduced media are blurred. CRTs were worse than current technology, resulting in displayed images that were considerably blurrier than the transmitted images, which themselves were blurred on collection and analog transmission. Digital images are blurred on collection, although light field cameras seem to be getting around this, and digital displays are physically much less blurred. Maybe those of us who grew up watching CRT images, and accepting them as a special sort of normal, adapt more than the young people who are growing up with high-resolution LCD images?

5. Texture adaptation, i.e. adaptation to the local slope of the amplitude spectrum, i.e. exactly what is being manipulated in the experiments. This would be fine. Testing it would be a bit different; subjects would need to identify the grain or scale of a texture, something like that. I think that the materials perception people have done things like this. Anyways, this sort of adaptation makes sense. You might look at an object at a distance and barely be able to tell that its surface has a fine-grain texture, so a bit of local adaptation would allow you, after a few seconds, to see those small details. On the other hand, if you get in really close to the object so that the texture is loud and clear, and you can even see the texture of the elements of the larger texture, especially if there's a lot of light and the texture elements are opaque, this is effectively a much sharper texture than what you were seeing before, even within the same visual angle. The 1/f property of natural images is an average characteristic. Locally, images are lumpy in that objects represent discontinuities; textures on surfaces usually have a dominant scale, e.g. print on a page has a scale measured in points, and that will show up as a peak in the amplitude spectrum. So, texture adaptation, where the system wants to represent detail, seems like a plausible function for what we're calling blur adaptation. Maybe the system should work better somehow if images are classed in this way?

6. Parafoveal or 'off-attention' defocus. We almost always fixate things that are sharp, but if the fixated object is small, whatever is behind it will be blurred optically. Similar situation if the fixated object is viewed through an aperture, the aperture will be blurred. Whatever adaptation occurs in this situation must be passive, just contrast adaptation, as I can't imagine that there's much utility to the small gain in detail with adaptation to a gaussian blur.

For all of these situations, spatial selectivity makes sense but is not necessary. Even if you're viewing a scene through fog, nearby objects will be less fogged than faraway objects, but it all depends on where you're fixating; other object at different depths will be more or less fogged. At any rate, foveal or parafoveal adaptation is most important, as peripherally viewed details are, as far as I can understand, subordinate. If the process is spatially localized, as it should be if it is what it seems to be, then global adaptation is just a subset of all possible adaptation configurations. Temporal selectivity is more questionable. If the process is genuine, and not just broadband contrast adaptation (though this begs the question of what should the timecourse be for contrast adaptation), how fast should we expect it to be? If it's mostly used for long-term (minutes) activities (fixating muddy water, looking for fish; other veiling glare situations; gooey eyeball; accommodation failure), maybe it could stand to be slower, with a time constant measured in seconds, or tens of seconds. If it's mostly used for moment-to-moment changes in fixated structure, i.e. texture adaptation or depth (off-attention), it should be fast, with a time constant measured in hundreds of milliseconds.

Actually measuring the temporal properties of the adaptation might therefore help to some degree in understanding what the process is used for.

Sunday, November 25, 2012

reading about history

An idle essay on history, for the holiday!

In the past couple of years, a good portion of my recreational reading has been history, and some of that has been by ancient historians: Plutarch, Sima Qian, Livy. For the past few weeks, I've been alternating between two books, a collection of abridged Livy (from the Ad Urbe Condita) and Wittgenstein's Tractatus Logico-Philosophicus, which is a study of how language is connected, or can potentially be connected, to reality. I'm not claiming to fully understand the Wittgenstein, but there has been an interaction.

There are lots of reasons why reading history is enjoyable. The main reason, for me, is that it is so edifying: you are learning how the world came to be the way that it is, and you're also learning about certain constancies of the human condition, mistakes and actions and etc that have been repeated over and over again for thousands of years. Another reason is that it is entertaining in the same way that reading fiction is entertaining: there are heroes and villains, victories and tragedies, and all of it is ambiguous and complex, at least in hindsight.

What the TLP made me think about was this (although not in the confusing terms of propositions, pictures, facts, etc): the page one reads is a surface into which has been pressed different shapes. When one reads, one is feeling these shapes, and mentally reconstructing whatever it was that impressed them. When one reads fiction, the impressor is, supposedly, always secondhand, in that it is the mind of the author that has been impressed, and the author has reconstructed ideas based on those impression, recombined them into mental realities, and then created new impressions based on those mental realities in the page. One then uses those impressions to reconstruct the author's mental realities. Since these reconstructions are not based on physical reality, they constitute in the language of the TLP false facts (although, strictly, many of the components of these false facts must be true; a falsehood cannot be sensible if it is not seemingly possible, its possibility being dictated by the local truth of its parts).

When one reads history, then the intention is that physical reality is impressed into the page, and that when one reads history and reconstructs his own mental realities, these should be (or be close to being) true facts. This is the intention of the honest historian, but he must inevitably fail, because he cannot base all, or even most, of his impressions on physical realities. Historians gain their knowledge by reading what was written by others before them, and then they compile what they have read into narratives that can be understood holistically by others. The historian must judge what are true and false facts, and impress only the true facts. Since other writers may not have thought of themselves as historians, and may not have been intent on impressing true facts, these judgments will be difficult, and the historian will sometimes fail.

So, when reading history as a naive consumer of text like myself, one is in the interesting situation of feeling out these impressions and forming mental reconstructions of the impressors, which are actually impressions of reconstructions of impressors that are actually reconstructions themselves and et cetera. Some of the impressions are mostly true (with local falsehoods), and some must be mostly false (with local truths). It's like Indiana Jones and the Holy Grail, except there's no reward or punishment for deciding that one or another fact is true or false. In reading fiction, the decision is implicit in the definition, but in reading history, you get the sense of walking along the true side of a very fuzzy edge, a transition into the false side. This transition gets broader and broader the further back in time one goes.

This then gets back to another issue which I'd like to write about sometime: the ubiquity of blur. All systems for transmitting information lose local details before they lose fundamentals. High spatial frequencies are lost in image formation; high temporal frequencies are lost as sound travels through a medium; sharp edges on an object are worn down by friction over time; genetic mutations effect molecular changes in the phenotype; and the details of history - names, dates, the precise unfolding of events - are misremembered or, mostly, forgotten. These are details in the literary sense, but they seem exactly analogous to physical details: what happened in Caesar's final days? Did he go to the forum in spite of warnings? Was Brutus really his son? These sorts of details, the answers to these sorts of questions, are permanently forgotten, but we know the larger, deeper, important events: Caesar was murdered by a conspiracy of Senators.

Interestingly, in the same way that a knife might be sharpened, or faded images might be retouched, old stories about the past might be sharpened up with added details; doped with false facts, to bring them into narrative focus. Caesar was warned about the Ides of March; he saw Brutus and said, "You too, my son?" The doping could also be with irrelevant facts: this is what you could buy from a street vendor in those days, this is what the men and women of this station wore on their feet. This sharpening, false or irrelevant, is enjoyable in a special way when it comes from someone who was writing more than 2000 years ago, because it is more immediate: nothing (except for the translator) has touched these impressions since they were formed. It's like holding something very, very old in your hands.

Sunday, November 18, 2012

finally a post about those eye crank lines

has anyone ever tested basic visual psychophysics as a function of gaze direction? i don't think so. would it be interesting or important to do so? i think so.

1. when i crank my eyes out as far as i can, i see weird phosphene patterns around my foveae (below). nobody has given me a good explanation for what these phosphenes are, except that they are probably produced by some sort of tension or torsion on the optic nerve. this isn't much of an explanation, because the phosphenes are so local and fine that if it was torsion i would expect them to be everywhere. it could be the correct explanation, but then i need an explanation for why they aren't everywhere, or what is special about foveal optic nerve fibers etc etc in their placement in the optic nerve. the sort of thing i guess i could figure out from reading.
whatever the cause of this effect, it means that in the extreme, direction of gaze has an effect on low-level perception, i.e. i am seeing spatial phosphenes - which, really, look like band-pass patterns - and not hallucinating faces or whatever. so, it stands to reason that less extreme directions might also have effects that are more subtle.

anyways, i hope i am not tearing apart my optic nerves by doing this experiment. i try not to do it too often, but it's like thinking about reciting pi. when you think about reciting pi, you have to recite as many digits as you can remember. you can't stop. give me a second.

2. if e.g. contrast sensitivity is entirely determined by retinotopically coordinated visual mechanisms - i.e. retina, LGN, V1, striate cortex - direction of gaze shouldn't make any difference, because these areas don't know anything about direction of gaze. but visual areas in the parietal cortex do know about direction of gaze - areas like LIP and VIP combine input from the visual system, of such quality that it is used to plan eye movements, with proprioceptive, vestibular, motor, and other inputs.

it's implicit in the theory of psychophysics - the theory that physical stimuli are translatable into perceptual states, which are then behaviorally accessible - that the last stage of vision is motor, since no psychophysics can be done without motor responses. this is one reason why neuroimaging is not psychophysics.

so, if vision interacts with non-visual inputs, and if these same inputs mediate behavioral measurement of visual ability - i.e. psychophysics - then is it reasonable to suppose that direction of gaze should affect basic visual abilities? a good hypothetical mechanism for producing an effect would be the internal noise source. no one should suppose that the noise limiting performance is entirely visual, because this assumes that the rest of the system is deterministic, which it is not. since the rest of the system is not deterministic, the portion of the random variation that is contributed by the parietal cortex might well vary with the tonic motor state of the system; the part of the brain that is guiding or maintaining the motor aspects of the system, and mediating the responses of the system according to the experiment design, might be better adapted or learned in one gaze state than in others.

3. visual neglect. i guess this is a higher-level thing, but from what i've heard, it's independent of basic sensitivity; how could this have been confirmed? how can basic testing be carried out with the same quality in the neglect region as in the unaffected region? this sounds like something that's been tried over and over, and that i could go read about. a quick survey of some titles, abstracts, and a couple of the most relevant-sounding papers suggests that when such sensitivity has been measured, its in the non-neglect areas, but that the researchers are nonetheless looking for a connection. there's a paper where they suggest there's no difference in contrast sensitivity or s.f. discrimination between two groups of stroke patients, some with neglect symptoms, some without; that could mean that even a stroke big enough to cause neglect, while sparing early visual cortex, won't bother basic sensitivity, or that any serious enough stroke will impair sensitivity on basic tasks. hm...

Thursday, November 15, 2012

stack puzzle

Okay, I’ve been wondering for a while whether or not something is a valid question – a good question or a bad question. It is related to a few entries I’ve written here in the past year (esp. this and this), and to a paper that I’m about to get ready for submission.

The question: are the percepts contributed by different layers or modules of visual processing perceived as embedded within one another, or as layered in front of or behind one another?

Such percepts could include brightness, location and sharpness of an edge, its color, its boundary association; color and shape and texture of a face, its identity, its emotional valence, its association with concurrent speech sounds; scale of a texture, its orientation, its angle relative to the frontal plane, its stereoscopic properties.

All of these, and more, are separately computed properties of images as they are perceived, separate in that they are computed by different bits of neural machinery at different parts of the visual system hierarchy. Yet, they are all seen together, simultaneously, and the presence of one implies another. That is, to see an edge implies that it must have some contrast, some color, some orientation, some blur; but this implication is not trivial. That is, a mechanism that senses an edge does not need to signal contrast or color or orientation or scale; the decoder could simply interpret the responses of the mechanism as saying ‘there is an edge here’. To decode the orientation of an edge requires that many such mechanisms exist, each preferring different orientations, and that some subsequent mechanism exists which can discriminate the responses of one from another, i.e. the fact that the two properties are both discriminable (edge or no; orientation) means that there must be a hierarchy, or that there must be different mechanisms.

So, whenever something is seen, the seeing of the thing is the encoding of the thing by many, many different mechanisms, each of which has a special place in the visual system, a devoted job – discriminate orientation, discriminate luminance gradients, discriminate direction of motion, or color, etc.

So, although we know empirically and logically that there must be different mechanisms encoding these different properties, there is no direct perceptual evidence for such differences: the experience is simultaneous and whole. In other words, the different properties are bound together; this is the famous binding problem, and it is the fundamental problem of the study of perception, and of all study of subjective psychology or conscious experience.

This brings us to the question, reworded: how is the simultaneity arranged? From here, it is necessary to adopt a frame of reference to continue discussion, so I will adopt a spatial frame of reference, which I am sure is a severe error, and which is at the root of my attempts so far to understand this problem; it will be necessary to rework what comes below from different points of view, using different framing metaphors.

Say that the arrangement of the simultaneous elements of visual experience is analogous to a spatial arrangement. This is natural if we think of the visual system as a branching series of layers. As far as subjective experience goes, are ‘higher’ layers in front of or behind the ‘lower’ layers? Are they above or below? Do they interlock like... it is hard to think of a metaphor here. When do layers, as such, interlock so that they form a single variegated layer? D* suggested color printing as something similar, though this doesn’t quite satisfy me. I imagine a jigsaw puzzle where the solution is a solid block, and where every layer has the same extent as the solution but is mostly empty space. D* also mentioned layers of transparencies where on each layer a portion of the final image – which perhaps occludes lower parts – is printed; like the pages in the encyclopedia entry on the human body, where the skin, muscles, organs, bones, were printed on separate sheets.

But after some thought, I don't think these can work. An image as a metaphor for the perceptual image? A useful metaphor would have some explanatory degrees of freedom; one set of things that can be understood in one way, used to understand something different in a similar way. Where do we get by trying to understand one type of image as another type of image? Not very far, I think. The visual field is a sort of tensor: at every point in the field, multiple things are true at the same time, they are combined according to deterministic rules, and a unitary percept results. Trying to understand this problem in terms of a simpler type of image seems doomed to fail.

So, whether or not there is a convenient metaphor, I think that the idea of the question should be clear: how are the different components of the percept simultaneously present? A prominent part of psychophysics studies how different components interact: color and luminance contrast, or motion and orientation, but my understanding is that for the most part different components are independently encoded; i.e. nothing really affects the perceived orientation of an edge, except perhaps the orientations of other proximal (in space or time) edges.

Masking, i.e. making one thing harder to see by laying another thing in proximity to it, is also usually within-layer, i.e. motion-to-motion, or contrast-to-contrast. Here, I am revealing that my thinking is still stuck in the lowest levels: color, motion, contrast, orientation, are all encoded together, in overlapping ensembles. So, it may well be that a single mechanism can encode a feature with multiple perceptual elements.

Anyways, the reason why I wonder about these things is, lately, because of this study where I had subjects judge the contrast of photographic images and related these judgments to the contrasts of individual scales within the images. This is related to the bigger question because there is no obvious reason why the percept contrast of a complex, broadband image should correspond to the same percept contrast of a simple spatial pattern like a narrowband wavelet of one type or another. This is where we converge with what I have written a few months ago: the idea of doing psychophysics with simple stimuli is that a subject’s judgments can be correlated with the physical properties of the stimuli, which can be completely described because they are simple. When the stimuli are complex and natural, there is a hierarchy of physical properties for which the visual system is specifically designed, with its own hierarchy, to analyze. Simple stimuli target components of this system; complex stimuli activate the entire thing.

It is possible that when I ask you to identify the contrast – the luminance amplitude – of a Gabor patch, you are able to do so by looking, from your behavioral perch, at the response amplitude of a small number of neural mechanisms which are themselves stimulated directly by luminance gradients, which are exactly what I am controlling by controlling the contrast of the Gabor. It is not only possible, but this is the standard assumption in most contrast psychophysics (though I am suspicious that the Perceptual Template people have fuzzier ideas than this, I am not yet clear on their thinking – is the noisiness of a response also part of apparent magnitude?).

It is also possible that when I ask you to identify the contrast of a complex image, like a typical sort of image you look at every day (outside of spatial vision experiments), you are able to respond by doing the same thing: you pool together the responses of lots of neural mechanisms whose responses are determined by the amplitude of luminance gradients of matched shape. This is the assumption I set out to test in my experiment, that contrast is more or less the same, perceptually, whatever the stimulus is.

But, this does not need to be so. This assumption means that in judging the contrast of the complex image, you are able to ignore the responses of all the other mechanisms that are being stimulated by the image: mechanisms that respond to edges, texture gradients, trees, buildings, depth, occlusions, etc. Why should you be able to do this? Do these other responses not get in the way of ‘seeing’ those more basic responses? We know that responses later in the visual hierarchy are not so sensitive to the strength of a stimulus, rather they are sensitive to the spatial configuration of the stimulus; if you vary how much the configuration fits, you will vary the response of the neuron, but if you vary its contrast you will, across some threshold, turn the neuron on and off.

I don’t have a solution; the question is not answered by my experiment. I don’t doubt that you can see the luminance contrast of the elements in a complex scene, but I am not convinced that what you think is the contrast is entirely the contrast. In fact, we know for certain that it is not, because we have a plethora of lightness/brightness illusions.

No progress here, and I'm still not sure of the quality of the question. But, maybe this way of thinking can make for an interesting pitch at the outset of the introduction of the paper.

Thursday, November 08, 2012

meh

I keep noticing, lately, near- and far-peripheral flashes, phosphenes. There was one a few minutes ago, maybe 10deg below fovea, very obvious and yet hard to localize (it was almost as though it extended close to the fovea); I checked for a blindspot, found none. So, based on all these recent sparky things, I predict something happening in the next few days (especially since the BA paper is just about done, so I'm about to go through another relax-contract phase).

Monday, November 05, 2012

probability/likelihood

probability of an event occurring
likelihood of a condition existing

how often have i misused these words? unknown.

if i search this blog, i find one clear misuse of 'likelihood', in "a specific instantiation..." ("likelihood of a pass"); i use the term two other times, in the first post ever and in a later one that refers to that one. in those instances (likelihood that you are alive at age x) i think it's ambiguous, but i'll count those as accurate.

amazingly, there is only one post where i use the word 'probability' in the relevant context. and i can't tell if i'm using it right or not. i'm kind of disappointed in myself.

seems i've fallen off the HAZ-PJ wagon. writing is going well, though, which is good.

Friday, October 26, 2012

government as a design problem

trying to work on a paper revision due sooner and sooner, but i keep thinking about politics. of course, it is The Time to think about politics, but i wish i could escape it.

anyways, here's what i've been thinking, a tiny idea:

from the institution of a new state or government, for a time, it is reasonable to expect the government to grow and acquire new features. this is just because upon its institution, the government must be incomplete or flawed. virtually nothing complex can approach perfection, especially in its first design.

however, at some point, we might consider the institution - or, and here's the real idea, a given version of the institution - to be complete. that is, we have this complex structure, with many parts and many layers and many functions, and it is intended to accomplish many things under particular constraints. presumably, changes made to this structure over time are intended to fulfill these intentions. we could think of this as efficiency, i.e., how much of what the system is meant to do is it actually doing? this is a funny idea, since it implies that if the system exceeds its mandate, it is being overly efficient. i will get back to this in a moment.

the idea is that a version of the institution can be considered complete, in that a time will come when it's clear to everyone that no changes, or only basic maintenance changes, are necessary to meet the objectives of the system; or, it might be decided that the objectives are outdated, and that new objectives have arisen, and that a new system needs to be designed to replace the old one. have we ever reached that point with the american federal government? i think maybe we have, and it was a long time ago: pre-civil war, really. in the 1850s, the federal government wasn't really creating many new responsibilities for itself, and was instead preoccupied with its intended functions of maintaining relations between the states, applying tariffs in international trade, occupying new territories that would eventually become states, etc. i think this is the tail end of what historians refer to as the "second party system": FED2.0. FED2.0 was rolled out in the 1830s, had some successes early on, and then crashed and burned.

it was around the time of the civil war that the government basically went through a big redesign, acquiring new responsibilities which then required new features to be fulfilled. this was the "third party system" that lasted until the 1890s, when it was replaced with FED4.0, which lasted until the great depression. versions 3 and 4, i think, are not really considered to be very good versions (and probably could be collapsed into subversions of FED3), while a lot of people are clearly very nostalgic for versions 1.0 and maybe 2.0 (and might see those as subversions of FED1).

in the 1930s, the government went through a huge redesign: FED5.0; the end of the 1960s saw a big advance on this (FED5.1), and now we're probably at version 5.3 or 5.4. version 5 is the longest-lived political system that the US has had (or similar with FED3/4). clearly, i think, it's time for a redesign. at this point, the two parties are just concerned with adding, subtracting, or modifying features, with a strong tendency towards addition (the 'ratchet effect' or 'featuritis'). i think that a lot of people thought that with o* and the d*s, after the 2008 election, we would be moving on to a new version 6; a lot of people thought that in 2004 with b* and the r*s. neither succeeded; i don't think that either really succeeded in moving a new subversion, either: we're stuck in beta, at 5.3.2 or something like that.

so, back to 'excess efficiency'. what is that? it's not what it sounds like. when a system isn't quite fulfilling its promised aims, if it wants to preserve itself (consider that institutions don't want to die), it might throw up new proxy aims. it can them give the illusion of accomplishment or fulfillment by moving to meet those new aims, thus obscuring the fact that the old aims aren't exactly complete; or, that they're no longer valid, and that the system thus is working to fulfill aims that no longer exist. i.e., excess efficiency is a sign that a system is desperate and needs to be replaced.

Monday, October 22, 2012

taxes and politics

a friend posted this link on facebook, along with a quote to the effect of, "raising taxes to pay for investments in the middle class creates jobs". i resisted posting a response there because i don't like to argue about these things and would rather keep my opinions to myself, and because (relatedly) i am afraid to affect others' opinions of me in ways that i don't have close control over. so i thought i'd post a response here, where no one can read it:

***

while i agree generally with sentiment that says the rich should be taxed relatively more, the idea that this is then turned around by the federal government into "investment in the middle class" is not obvious to me. i think that very little of taxation, at least in a developed country like the US, translates directly into economic growth. in fact i think it tends to be the opposite, and i agree more with the idea that raising taxes tends to suppress growth.

a large portion of government spending put in place by the democratic party (which is presumably the favorable political dimension for the approving audience of this talk) is in the form of political favors to constituencies that have an insignificant impact on the economy (poor, elderly); institution of new bureaucracies which have to be funded at the same time that their mandate is usually to impose some form of *restriction* on certain types of economic activity; increased funding of dysfunctional programs without improving function ("education"); and, you can be sure that the more the US government collects in taxes, the more it will spend on the military, or on foreign aid, etc.

interesting case in point relevant to our livelihoods: significant government spending goes into biomedical research, which winds up making people live longer at the same time that it makes all forms of healthcare more expensive (MRI for everybody! one-of-a-kind cancer drug for my grampa! YOU CAN LIVE FOREVER NOW). i guess this creates jobs in the hospital/rest home industries.

*not that any of these things are wrong per se*, but it's not clear how any of this works as investment in the consumer class that generates net jobs. i think the government of a developed country actually has very little capacity to "create jobs", except in managing trade policy and maintaining transportation infrastructure. i.e. i think this guy's argument is pretty arguable.

Sunday, October 14, 2012

lull

finally working on that blur adaptation paper. not much else to think about or report.

***

last saturday (the 6th) woke up with a headache, fairly painful: i'd rate the usual ones at 2/10, and this was a 4/10. today, i wake up with one even worse: i'd put this at 6/10 (assuming it can get much worse). this is awful - it's as bad as that night tukrong punched me in the head 10 times. what is going on with my brain?

Friday, October 05, 2012

task done

we made it: the proposal is submitted. transitioning to revising papers. woo hoo?

Wednesday, October 03, 2012

inevitable negativity


i am now (technically) a faculty member at harvard medical school ("instructor": about as junior junior junior as possible)! wow! and, (technically), no longer a postdoctoral fellow: i am now a "senior scientific associate". all so i can apply for a grant with a less than a 1% chance of getting funded (optimistic i am). so, something there. beautiful appearance of progress.

also, couple of papers accepted; probably will have a paper in PLoS-one, which is nice, but i'm third of four authors, so..

***

came up with this on the train, coming home last friday night (9-28-12)

on Cambridge Street
put away
your umbrellas
or they'll wind up
cast aside
in tattered heaps
abandoned

on Cambridge Street
thrust your head
into the wind
and bear the rain
it's autumn
it's not cold yet
be thankful

Sunday, September 30, 2012

中秋快乐!

quick notes for the end of september:

week 1 of bring-your-laptop-to-work was a success; worked steadily in the lab every day, and came home each night to do particular jobs by hand, with pen and paper. extremely effective. laptop came back home friday night; going to continue this for the foreseeable future. should make the next MS revision and the following MS submission much easier.

headache last night, gradual onset; eventually focused pain above right eye socket; photophobia; went to bed, closed eyes, weird eigenlicht flicker, maybe 40-50Hz; what is that? slight headache remnant now, indistinct.

recent weirdness with reading text, usually notice in the morning; right now, left of fixation feels scotoma-like, but i can see there..

**

also, a story: when i sit at the kitchen table, in the chair by the window, i have a view of the pantry area, with the fridge and the back door. my leather sandals are wedged between the fridge and the wall, by the door, so i can wear them outside when i go to throw trash out.

i regularly mistake the sandals, peripherally, for Olive the Cat, sitting by the back door, wanting to go out. then i foveate them, and see that they are my sandals. this has happened repeatedly, maybe dozens of times: deja trompé!

Tuesday, September 25, 2012

why do i keep writing poems

Batten down the hatches!
In this electric squall
Or else we'll be sent to the deep -
The web will drown us all.

So home I'll go! To printed word,
With pen and paper work.
No opportunity to drift
Through forums or to lurk

In hiding from my calling,
I'll forge ideas by thought
And stare down syntax, words reform
To make all logic-wrought.

So batten down the hatches!
And keep the ship afloat
For though I'll try to steer us,
The net may wreck this boat.