Feeds:
Posts
Comments

Archive for the ‘algorithm’ Category

And I have to start this essay with a simple statement that it is not lost on me that all of the above is 100% derived from my own history, studies, jobs, art works, and everything else that goes into me.  So maybe this is just a theory of myself or not even a theory, but yet another expression in a life time of expressions.   At the very least I enjoyed 20 hrs of re-reading some great science, crafting what I think is a pretty neat piece of art work, and then summarizing some pondering.   Then again, maybe I’ve made strides on some general abstract level.  In either case, it’s just another contingent reconfiguration of things.

At the end I present all the resources I read and consulted during the writing (but not editing) and the making of the embedded 19×24 inch drawing and ink painting (which has most of this essay written and drawn into it).   I drank 4 cups of coffee over 5 hrs, had 3 tacos and 6 hotwings during this process. Additionally I listened to “The Essential Philip Glass” while sometimes watching the movie “The Devil Wears Prada” and the latest SNL episode.

——————-  

There is a core problem with all theories and theory at large – they are not The t=Truth and do not interact in the universe like the thing they refer to.   Theories are things unto themselves.  They are tools to help craft additional theories and to spur on revised dabbling in the world.

FullSizeRender (4)

We have concocted an unbelievable account of reality across religious, business, mathematical, political and scientific categories.  Immense stretches of imagination are required to connect the dots between the category theory of mathematics to radical behaviorism of psychology to machine learning in computer science to gravitational waves in cosmology to color theory in art.  The theories themselves have no easy bridge – logical, spiritual or even syntactically.

Furthering the challenge is the lack of coherence and interoperability of measurement and crafting tools.   We have forever had the challenge of information exchange between our engineered systems.   Even our most finely crafted gadgets and computers still suffer from data exchange corruption.   Even when we seem to find some useful notion about the world it is very difficult for us to transmit that notion across mediums, toolsets and brains.

And yet, therein lies the the reveal!

A simple, yet imaginative re-think provides immense power.   Consider everything as network.  Literally the simplest concept of a network – a set of nodes connected by edges.   Consider everything as part of a network, a subnetwork of the universe.  All subnetworks are connected more or less to the other subnetworks.   From massive stars to a single boson, all nodes in a network and those networks of networks.   Our theories are networks of language, logic, inference, experiment, context.  Our tools are just networks of metals, atoms, and light.   It’s not easy to replace your database of notions reinforced over the years with this simple idea.

But really ask yourself why that is so hard but you can believe that blackholes collide and send out gravitational waves that slightly wobble spacetime 1.3 billion light years away or if you believe in the Christian God, consider how that’s believable and that woman was created from a guy named Adam’s rib.    It’s all a bit far fetched but we buy these other explanations because the large network of culture and tradition and language and semiotics has built our brains/worldviews up this way.

Long ago we learned that our senses are clever biological interpreters of internal and external context.  Our eyes do not see most of “reality” – just a pretty course (30 frames per second) and small chunk of electromagnetic waves (visible light).   in the 1930s we learned that even mathematics itself and the computers we’d eventually construct can not prove many of the claims they will make, we just have to accept those claims. (incompleteness and halting problem.).

These are not flaws in our current understanding or current abilities.  These are fundamental features of reality – any reality at all.  In fact, without this incompleteness and clever loose interpretations of information between networks there would be no reality at all – no existence.   This is a claim to return to later.

In all theories at the core we are always left with uncertainty and probability statements.   We cannot state or refer to anything for certain, we can only claim some confidence that what we’re claiming or observing might, more or less, be a real effect or relation.   Even in mathematics with some of the simplest theorems and their logical proofs we must assume axioms we cannot prove – and while that’s an immensely useful trick it certainly doesn’t imply that any of the axioms are actually true and refer to anything that is true or real.

The notion of probability and uncertainty is no easy subject either.   Probability is a measure of what?   It is a measure belief (Bayes) that something will happen given something else?  Is it a measure of lack of information – this claim is only X% of the information?  Is it a measure of complexity?

IMG_4369

Again, the notion of networks is incredibly helpful.  Probability is a measure of contingency.   Contingency, defined and used here, is a notion of connectivity of a network and nodes within the network.  There need be no hard and fast assignment of the unit of contingency – different measures are useful and instructive for different applications.  There’s a basic notion at the heart of all of them: contingency is a cost function of going from a configuration to another configuration of the network.

And that leads to another startling idea.   Spacetime itself is just a network.  (obvious intuition from my previous statement) and everything is really just a spacetime network.    Time is not the ticks on a clock nor an arrow marching forward.  Time is nothing but a measure of steps to reconfigure a network from state A to some state B.   Reconfiguration steps are not done in time, they are time itself.

(most of my initial thinking comes from Wolfram and others working on this long before my thinking about it: http://blog.stephenwolfram.com/2015/12/what-is-spacetime-really/ – Wolfram and others have done a ton of heavy lifting to translate the accepted theories and math into network terms).

This re-framing of everything into network thinking requires a huge amount of translation of notions of waves, light, gravity, mass, fields, etc into network conventions.  While attempting to do that in blog form is fun and I’ve attempted to keep doing it, the reality of the task is that no amount of writing about this stuff will make a sufficient proof or even useful explanation of the idea to people.

Luckily, it occurred to me (a contingent network myself!) that everyone is already doing this translation and even more startling it couldn’t go any other way.   Our values and traditions started to be codified into explicit networks with the advent of written law and various cultural institutions like religion and formal education.   Our communities have now been codified into networks by online social networks.  Our location and travels have been codified by GPS satellites and online mapping services.  Our theories and knowledge are being codified into Wikis, Programs (Wolfram Alpha, Google Graph, Deep Learning networks, etc).   Our physical interpretations of the world have been codified into fine arts, pop arts, movies and now virtual and augmented realities.   Our inner events/context are being codified by wearable technologies.    And now the cosmos has unlocked gravitational waves for us so even the mystery of black holes and dark matter will start being codified into knowledge systems.

It’s worth a few thoughts about Light, Gravity, Forces, Fields, Behavior, Computation.

  • Light (electromagnetic wave-particles) is the subnetwork encoding the total configurations of the entire universe and every subnetwork.
  • Gravity (and gravitational wave-particles) is the subnetwork of how all the subnetworks over a certain contingency level (mass) are connected.
  • Other 3 fundamental Forces (electromagnetics, weak nuclear, strong nuclear) are also just subnetworks encoding how all subatomic particles are connected.
  • Field is just another term for network, hardly worth a mention.
  • Behavior observations are partially encoded subnetworks of the connections between subnetworks.  They do not encode the entirety of a connection except for the smallest, most simple networks.
  • Computation is time is the instruction set is a network encoding how to transform one subnetwork to another subnetwork.

These re-framed concepts allow us to move across phenomenal categories and up and down levels of scale and measurement fidelity.  They open up improved ways of connecting the dots between cross-category experiments and theories.   Consider radical behaviorism and schedules of reinforcement combined with the Probably Approximately Correct learning theory in computer science against a notion of light and gravity and contingency as defined above.

What we find is that learning and behavior based on schedules of reinforcement is actually the only way a subnetwork (say, a person) and a network of subnetworks (a community) could encode the vast contingent network (internal and external environments, etc).   Some schedules of reinforcement maintain responses better than others, and again here we find the explanation.  Consider a Variable Ratio schedule reinforcing a network.  (see here for more details: https://en.wikipedia.org/wiki/Reinforcement#Intermittent_reinforcement.3B_schedules).   A variable ratio (a variations/compositions on this) schedule is a richer contingent network itself that say a fixed ratio network.  That is, as a network encoding information between networks (essentially a computer program and data) the variable ratio has more algorithmic content to keep associations linked after many related network configurations.

Not surprisingly this is exactly the notion of gravity explained above.  Richer, more complex networks with richer connections to other subnetworks have much more gravity – that is they attract more subnetworks to connect.  They literally curve spacetime.

To add another wrinkle in theory, it has been observed in a variety of categories that the universe seems to prefer computational efficiency.  Nearly all scientific disciplines from linguistics to evolutionary biology to physics to chemistry to logic end up with some basic notion of “Path of Least Effort” (https://en.wikipedia.org/wiki/Principle_of_least_effort).  In the space of all possible contingent situations networks tend to connect in the computationally most efficient way – they encode each other efficiently.  That is not to say it happens that way all the time.  In fact, this idea led me to thinking that while all configurations of subnetworks exist, the most commonly observed ones (I use a term: robust) are the efficient configurations.  I postulate this explains mathematical constructs such as the Platonic solids and transcendental numbers and likely the physic constants.  That is, in the space of all possible things, the mean of the distribution of robust things are the mathematical abstractions.  While we rarely experience a perfect circle, we experience many variations on robust circular things… and right now the middle of them is the perfect circle.

IMG_4366

Now, what is probably the most bizarre idea of all:  nothing is actually happening at the level of the universe nor at the level of a photon.  The universe just is.   A photon, which is just a single massless node, everything happens to it all at once, so nothing happens.

That’s right, despite all the words and definitions above with all the connotations of behavior and movement and spacetime… experience and happening and events and steps and reconfigurations are actually just illusions, in a sense, of subnetworks describing other subnetworks.   The totality of the universe includes every possible reconfiguration of the universe – which obviously includes all theories, all explanations, all logics, all computations, all behavior, all schedules in a cross product of each other.   No subnetwork is doing anything at all, it simply IS and is that subnetwork within the specific configuration of universe as part of the wider set of the whole.

This sounds CRAZY.   until you look back on the history of ideas, this notion has come up over and over regardless of the starting point, the condition of the observational tools, the fads of language and business of the day.  It is even observable in how so many systems “develop” first as “concrete” physical, sensory things… they end up yielding time and time again to what we call the virtual – strangely looping recursive networks.   Here I am not contradicting myself, instead… this is what exists within the fractal nature of the universe (multiverse!) it is self similar all the way up and down scales and across all configurations (histories).

Theories tend to be ignored unless they are useful.   I cannot claim utility for everyone on this theory.  I do find it helpful for myself in moving between disciplines and not getting trapped in syntactical problems.   I find confirmation of my own cognitive bias in the fact that the technology of loosely connecting the dots like GPS, hyperlinks, search engine, social media, citation analysis, Bayes, and now deep learning/PAC have yielded tremendous expansion of information and re-imaging of the world.

IMG_4355

Currency, writing, art, music are not concrete physical needs and yet they mediate our labor, property, government, nation states.   Even things we consider “concrete” like food and water are just encodings of various configurations.  Food can be redefined in many ways and has been over the eons as our abstracted associations drift.   Water seems like a concrete requirement for us, but us is under constant redefinition.  Should people succeed in creating human-like (however you define it) in computers or the Internet it’s not clear water would be any more concrete than solar power, etc.

Then again, if I believe anything I’ve said above, it all already exists and always has.

 

———————————–

 

Chaitin on Algorithmic Information, just a math of networks.
https://www.cs.auckland.ac.nz/~chaitin/sciamer3.html

Platonic solids are just networks
https://en.m.wikipedia.org/wiki/Platonic_solid#Liquid_crystals_with_symmetries_of_Platonic_solids

Real World Fractal Networks
https://en.m.wikipedia.org/wiki/Fractal_dimension_on_networks#Real-world_fractal_networks

Correlation for Network Connectivity Measures
http://www.ncbi.nlm.nih.gov/pubmed/22343126

Various Measurements in Transport Networks (Networks in general)
https://people.hofstra.edu/geotrans/eng/methods/ch1m3en.html

Brownian Motion, the network of particles
https://en.m.wikipedia.org/wiki/Brownian_motion

Semantic Networks
https://en.wikipedia.org/wiki/Semantic_network

MPR
https://en.m.wikipedia.org/wiki/Mathematical_principles_of_reinforcement

Probably Approximately Correct
https://en.m.wikipedia.org/wiki/Probably_approximately_correct_learning

Probability Waves
http://www.physicsoftheuniverse.com/topics_quantum_probability.html

Bayes Theorem
https://en.m.wikipedia.org/wiki/Bayes%27_theorem

Wave
https://en.m.wikipedia.org/wiki/Wave

Locality of physics
http://www.theatlantic.com/science/archive/2016/02/all-physics-is-local/462480/

Complexity in economics
http://www.abigaildevereaux.com/?p=9%3Futm_source%3Dshare_buttons&utm_medium=social_media&utm_campaign=social_share

Particles
https://en.m.wikipedia.org/wiki/Graviton

Gravity is not a network phenomenon?
https://www.technologyreview.com/s/425220/experiments-show-gravity-is-not-an-emergent-phenomenon/

Gravity is a network phenomenon?
https://www.wolframscience.com/nksonline/section-9.15

Useful reframing/rethinking Gravity
http://www2.lbl.gov/Science-Articles/Archive/multi-d-universe.html

Social networks and fields
https://www.researchgate.net/profile/Wendy_Bottero/publication/239520882_Bottero_W._and_Crossley_N._(2011)_Worlds_fields_and_networks_Becker_Bourdieu_and_the_structures_of_social_relations_Cultural_Sociology_5(1)_99-119._DOI_10.11771749975510389726/links/0c96051c07d82ca740000000.pdf

Cause and effect
https://aeon.co/essays/could-we-explain-the-world-without-cause-and-effect

Human Decision Making with Concrete and Abstract Rewards
http://www.sciencedirect.com/science/article/pii/S1090513815001063

The Internet
http://motherboard.vice.com/blog/this-is-most-detailed-picture-internet-ever

Read Full Post »

 
While I have many interests and ideas… the most of enduring is my own obsession over the nature of reality and specific spacetime. It’s probably been my guiding light since my much younger self around 14-16 started reading/toying with chaos theory, popular cosmology books and starting in roads into deeper than algebra mathematics. At the same time the theater bug struck in earnest as I struggled with a long involvement with Christianity and the bible. You put it all together and all of these things seemed to be asking questions about origins and the flow of time and cause and effect.
 
I have a bit of a revisionist/simplified story around why I went to University of Chicago… but a lot of my most basic thinking at the time was still about how to fully engage my obsession… it was very clear that was probably the only place I could go and chase this obsession in a world class physics and math department that just so happened to co-exist with amazing theater and improv comedy. (These things are related deeply, I swear, on some incredibly fundamental level.)
 
Somehow I managed to survive, barely, getting a theoretical (not applied) math degree (it’s still a mystery as to how I survived complex analysis) while performing in, directing or writing something like 40 theater shows… and then I went out into the real world no closer to understanding anything at all about the true nature of my obsession, spacetime.
 
Futzing about with first real world jobs but mostly sneaking off to Borders as often as I could I basically read almost every professional computer book I could as well as picked up A New Kind of Science, by Wolfram. In a mish-mash of messing around with programming/multi media side projects, shortlived w2 jobs and reading as much as I could… I finally devised a ridiculous plan. I would one day work under Stephen Wolfram and actually come to know his vision and math driving A New Kind of Science. All 10 billion pages of NKS seemed to overflow with consistent, mind blowing Yes This Could Actually Be The Basis of Reality stuff that somehow was bizarrely consistent with the bevy of other art, theater, religious, literary thoughts I’d come across on the matter.
 
So this plan… well first I knew that it wouldn’t be good enough to have “read” NKS, i would actually need to know how to use Mathematica and understand the theoretical and applied logic behind its operations. Being a resourceful young man with no shame I managed to convince my software provisioning team at the w2 job I had at the time to purchase me a license for Mathematica (those are expensive for non students!) because it was critical for the development of Online Advertising Recommendation Algorithms. Well, whatever, it worked and I was off and running learning and trying things out and mostly making a mess of my computers.
 
The plan needed to evolve as I wasn’t getting anywhere. in 2008 or so someone pointed me to the New Kind of Science summer school that Wolfram Research put on. Well, shoot! There ya go… I doubted whether I had any business in spending three weeks in Bernie Sanders country (VT!) hanging out with some of the smartest people I’d ever met doing theoretical physics and computer science… but having no shame… I wrote up a typo filled statement of my intentions and applied. I wrote a lengthy run on sentence piece about how I thought the approach of NKS could finally bridge the broken disciplines of cognitive psychology and economics and radical behaviorism (I said it somewhat differently… and live blogged my approach… shameless… http://socialmode.com/2008/03/21/anatomy-of-a-decision-in-life-applying-to-nks-summer-school/). Beyond the silly basis of my plan my wife and I also had two young kids and I didn’t really have a job job, just consulting gigs… so spending 3 weeks working on insanely theoretical/no-connection to my real life was even more ridiculous. but obsessions are obsessions…
 
Shorting the story here Wolfram invited me to the NKS school that summer where I decided to pursue a project on Turing Machines (http://socialmode.com/2008/08/07/nks-summer-school-summary/) that was pretty great to work on. I greatly improved my understanding of Mathematica, the beauty of turing and his machines, the lambda calculus as well as further confirmed I was as far away from understanding spacetime as ever. Beyond my project I had several deep interactions with SW and various members of his team. These all gave me better and better glimpses into this stuff… the other students also had a mix of unbelievably interesting perspectives in philosophy, neuroscience, medicine, architecture and so much more. I was under no delusion that I understood much of anything… much like my math degree in college… but I always bet on osmosis and you don’t know what you know and what you don’t know…. meaning, sometimes you know things but only by using it and applying it in different ways…
 
Ok, so having properly stoked the obsession I became more deeply enamored with things which led to more discussions with SW and ultimately to engaging their team in launching Wolfram|Alpha, which i had see while at the summer school and knew that I wanted to somehow be involved with it. Outside of NKS and my various reality seeking obsessions my own “professional” career had continued down the “search engine” path from SEO junk, to building various search engines/crawlers, playing with query semantics and indexing ideas, etc. etc. by this time I’d worked on several web scale search engine/recommendation engine/geo gis systems and everything in between. So doing Wolfram|Alpha was an obvious next step pro wise and obsession wise.
 
Well, beyond the fun times in trying to explain WA to the world and trying to figure out various business models my little spacetime obsession became an obsession with language (programming and otherwise) and probably what some would consider semiotics and other analysis of symbols. There was just something in NKS, math, mathematica, computers, turing machines, radical behaviorism, theater, religion, art, LIFE that scream SYMBOLICS… study of SYMBOLICS… oh and on and on and on.
 
I carried all of these obsessions from various bill paying gigs to the next… which was really just a front for me to continue buying computers and books at an alarming clip while not completely ruining my young children’s futures.
 
This sort of brings us back around to RIGHT NOW with this wonderful blog post from SW and my own current Art and Philosophy situation. His post still strikes me as On The Right Path. And it’s still not the full story… it’s even more fundamental than Space as a Network and it’s Just a Network and some simple rules… and the only way I’ve come to be able to work out the details is well, not to work out the details… but do as SW is doing… searching the space of possibilities… I’m just doing it through art, as my hunch (which is likely just a confusion of my obsession) is that an artistic exploration is Computational Equivalent to writing a bunch of symbolic programs AND may, in fact, be more efficient due to the nature of how humans (awesome multi faceted pattern recognizers) process data and the world that data represents. See here for some exposition and poke around the art… http://www.worksonbecoming.com/symbol-and-relation/
 
Look, perhaps this is all unknowable (likely) and perhaps I’m just a kooky guy who spent too much time with his nose in a book. What I learned though is that… this little obsession spun me off in a million directions gaining lots of little skills that all allowed me to navigate the weird business world, the slightly unnerving computer programmer culture, improved my literacy, help start a school, employ and raise up lots of ambitious upstart people and perhaps have made a couple of hundred million dollars here and there for folks, and now has me making art, mostly poorly conceived but done at a pace that fills me up.
 
perhaps that’s what spacetime is really about. using it in fulfilling ways.
 
perhaps everything is connected.

Read Full Post »

 

It’s nearly, if not totally, impossible to remove our deeply held biases, values and contextual history from our raw, sensory perceptions of the world. The difficulty to sense more objectively is what perpetuates so many non-truths about the world. Nearly everything we sense and think is distorted by the biological patterns shaped within us by the world and our interaction within the world. It is within this frame of reference I seek to put down, in an obviously flawed ways, what I think to be at least less non-truth than other theories and thoughts floating about out there.

Our most basic means of communication, the words, sounds, gestures and pictures, we use are so filled with bias it’s impossible to commit to their use in an objective way. The best hope I have is to present as many variations across mediums so that what emerges from these communications is perhaps, if not objective, at least more fully representative of various perspectives that at least the trap of obvious one-sided subjectivity is avoided.

And with that warning, let us proceed.

A first exercise is of definitions and clarifying of terms.

Everything is information. From the most basic particles of existence to governments to rocket ships to the abstractions of mathematics – everything is information. Information looped and entangeled within other information. Information trapped within patterns of information by other patterns of information. Particles trapped into behaviors dictated by the laws of physics. Proteins and chemicals replicating into biological entities by the encodings of genetic instruction. Objects of pure quantity expressed in combinations dictated by rules of provable logical inference. Symbols imbued with meaning combined to form words and sentences and stories that stick in the brains of people and come out of their mouths to be reinterpreted over the eons. Faintly remembered events strung together by stories to form history and imagined events of some time that has not come to pass forming a future hope.

More fundamentally… space and time and causality and logic and being itself. All are matters of information. The casual ordering of events in relation to what is different based on the difference of another entity forming the conception of time and space. The coherence within a frame of reference of words strung together with symbols for equal, not equal, for all, and the such coalescing into logic. What is and what isn’t in reference to what’s logically or causally sensible to us becomes the notion of being.

But this is not quite enough.

Recently various categories of research, science and/or philosophic discussion have added ’emergence’ and ‘complexity’ to the pantheon of fundamental concepts from which we can chart our maps of existence and meaning. The unseen in the parts that only shows itself in the collective – the multitude – the interactive, this notion of emergence.

All in – meaning. Meaning is a vague notion of symbolics and representation within the ontological dimensions of space, time, cause, logic, emergence and being. Meaning is proximal, local phenomenon of pattern. In totality, all things considered, that is all of infinity, there is no meaning – there is no pattern. That is, all patterns at play is pure entropy and no meaning is possible on a universal, infinite scale. (As if we can even imagine such a concept). On a local, limited frame of reference meaning emerges from patterns (people, computers, plants, etc) pattern matching (sensing, perceiving, transforming, encoding, processing).

I propose a phrase: existential equivalence. Every investigative thought, every scientific gesture, every act of art, every attempt to send a message, every ritual, every interaction at all with the world at any level is all of similar thing: the encoding and decoding of information within information. This is not a reduction or a reductionist exercise. Quite the contrary. The varieties of symbolic expression in all of existence is REAL, it is a thing. That existence is expressible in an infinite variety is necessary. and it can only be known, even in a limited way, by actual variety of expression. If anything is to exist, it must exist in infinite variety and multiplicity. Everything that exists has existential equivalence. The entirity of existence is relational.

For instance if there is such a concept and sensation of color it must have expression in physical and artistic and literary terms. It exists at all levels implicated there. If a wavelength of light is able to generate a visual and neuronal concept we called red, then red isn’t just the wavelength, nor the wave of light, nor the eye, nor the brain, nor the word… it is all of those things and all of the things we do not yet think or talk or gesture about.

Or consider a computer program. Its existence is a string of words and phrases transcoded into 1s and 0s and into physical logical gates transmitting electrons and back around and on itself into monitor LEDs into human eyes and brains into motor movements of mouse and keyboard and so on. A computer program is the interaction of all the information.

But surely there are such simple things that do not have a universal relationship – an existential equivalence? what is the simplest thing we can think or speak of? a boson? the number 1? a dot? just an abstract 1? It is impossible to wipe the complexity of existence from even these pure abstractions. We only conceive of their simplicity in relation to other concepts we find complex. Their simplicity must be weighed against everything that isn’t simple.

And so here we have a collosal contradiction. Patterns are a local phenomenon. They aren’t the entirety. And yet I’ve suggested that patterns are existence – all that exists. Unraveling this I am directly saying that patterns interpreting/transcoding/sensing patterns is what exists – creates th world – at all levels. Pure relation, which is only possible at a local level, is existence. Particles only exist in relation to other particles – a gradient. Humans to other humans, to animals, to the planet, to particles. Planets to other massive bodies… and so on, and on, up and down, left to right, back and forward, in and out….

herein lies a beautiful thing – mathematics and computation are a wonderfully efficient symbolic translation methods. This is why computers and mathematics always creep their way into our efforts to make things and make sense of the world. It is why our brains are so damn useful. complex abstract pattern recognizing patterns – these networks of neurons. It is why DNA is so proficient at replication. a “simple”, resilient substrate carrying everything necessary to generate and regenerate these networks of neurons that can then make synthetic networks of pure relation. Whether particles or quantum or digital or biological or chemical there is pure relation, pure patterns among patterns – there is math. It matters not and is completely the point that math and computation can be done in any substrate – between proteins, with pen and paper, on a calculator, in a quantum computer.

AND

why is that? WHY?

In a feat of complete and utter stupid philosophy and unlogic… because it cannot be any other way. Positing a god doesn’t escape this. Positing a multi-verse doesn’t escape this. If any of those things are to exist, they must exist still in relation – they are relation! It’s borderline mystical. Of course it is!

And why does any of this matter? is this just another sound of one hand clapping? a tree falls in a forest does it make a sound? Yes. yes indeed. Those, while used to dismiss the question from the outset actually do call attention to the entirety of the situation. What we conceive of as existence and existing is usually reductively done in by our discrete categorization and our failure to continuously review and revise our categories. The practical implications of this adherence to categories (zoology, isms, religion, gender, nations, science disciplines, etc) is what stunts our path towards knowledge and keeps us in fear.

If we don’t lean into the idea that everything has an existential equivalence we are simply deciding to be ignorant. And in that ignorance we trend towards non-existence. In every day terms if we see the human population only by the color of skin we diminish human existence. If we say and take for truth all of the -isms, reductions, and arbitrary definitions we snuff out relation. If we make any assumptions at all and refuse to question those assumptions, even what we think are so obvious and so simple, we move closer to entropy. If we want to exist at all, we must be mystical and fanatical about sensing relation, resensing it, re-interpreting it. This is not a moral argument. Existence is no more moral than non-existence – except as a local conception.

It really does come down to this (and this is very Camus-like):

If you care at all to exist as you, you must question/express/relate to everything as much as you can before your pattern is fully transcoded into something not you. (we are just food for worms…)

So yes, ask yourself and answer it in infinite variety over and over “if a tree falls in a forest does it make a sound?” This is life – it is your existential equivalence to everything else. You relate, therefore, you are. I relate, therefore I am. X is, therefore X relates.

Read Full Post »

20140120-121843.jpg

Certain activities are fundamental to the human endeavor.

The list:
Acquisition of food, shelter and water
Mate attraction and selection
Procreation
Acquisition or forage of information regarding the first three
Acquisition of goods and services that may make it more efficient to get the first three
Exchange of above three

Only software that deals directly with these activities flourishes into profitable, long term businesses.

I define software here as computer programs running on severs and personal computers and devices.

The race to the bottom in the pricing of information and software and hardware that runs that software ensures that only software businesses that scale beyond all competition can last. Scale means massive and efficient data centers, massive support functions and a steady stream of people talent to keep it all together. And the only activities in the human world that scale enough are those things that are fundamental activities to us all.

Sure there’s a place for boutique and specialist software but typically firms like that are swallowed by the more fundamental firms who bake the function directly into their ecosystem and then they give it away. And this is also why the boutique struggles long term. Those fundamental software builders are always driving the cost down. So even if a boutique is doing ok now it is not sustainable if it is at all relevant. It will be swallowed.

Open source software only reinforces this. In fact it takes this idea to the extreme. The really successful open source projects are always fundamental software (os, browser, web server, data processing) and further drive the price of software to zero.

Scale is the only way to survive in software.

This goes for websites, phone apps, etc. All the sites and apps that focus on niche interests that don’t deal with the fundamental activities above directly either get assimilated into larger apps and sites with broad function or they whiter and die unable to be sustained by a developer.

Read Full Post »

The idea of progress is a flimsy concept.  Nothing in the universe comes for free.  So when some system or entity “progresses” in comes at the expense of energy somewhere.  It’s not necessarily a wholly destructive expense but it is an expense nonetheless. The way in which we commonly talk about society, civilization and the human race is in terms of progress.  We’re progressing from a barbaric or unenlightened state to a state if self reliance and control and technologically enhanced awareness.  But this progress is mostly an illusion.  It comes at a great expense to other species,the planet and even ourselves.

Some conflicting reports:

http://humanprogress.org/ (there’s progress!)

http://en.wikipedia.org/wiki/Social_progress (there’s progress!)

http://reason.com/archives/2013/10/30/human-progress-not-inevitable-uneven-and (there is a thing called progress but we’re not always on it!)

http://people.wku.edu/charles.smith/wallace/S445.htm (there’s progress!)

http://www.alternet.org/environment/myth-human-progress (progress is an illusion!)

http://www.vice.com/read/john-gray-interview-atheism (there is no progress!)

(Another way to think about this is that everything is competing to exist against other things that also are fighting to exist.  The better we compete the more we extract from the ecosystems.)

Certainly we’ve increased our life expectancy on the whole and reduced violence and physical suffering in the human race. We have invented computers, figured out space flight, eradicated some diseases, taught billions to read and write.  All progress right?

To what end?  Where is all this progress going?  How is this progress measured?  Does a longer life mean a better life? Does a less violent life lead somewhere differently than a more violent one?

Perhaps even more challenging is figuring out whether we have a choice in the matter.  Are we even biologically, physically capable of not trying to progress in these dimensions and exert our competitive advantages upon or environment?  If we had some definition of how best to live in some philosophic sense and it differed materially with the progressive ways we’ve chased could we actually change?  Could we choose less technology and a culture more in balance with the environment?  And no there’s no “hippie” justification needed for this thinking.  The question is is there a way of life that is more sustainable and less extracting from the world than the way we currently live?  Or is our survival inexorably tied to dominating everything we can?

To make this very clear consider the species that have become extinct at the hands of humankind’s hunting.  http://en.wikipedia.org/wiki/Lists_of_extinct_animals
Our “progress” has led in many cases directly to their complete decline.  Who are we to say whether our progress is worth it – Was worth their demise?

I’m directly asking everyone what is the point of our focus on progress.  Certainly in America we are all put on a course to progress through life.  Our goal is clear to get through high school, go through college, and begin to produce.  One production should lead to ever more important positions in this progressive society with ever increasing economic output.  We measure all facets of our culture against GDP and endowments and ROI.  We do not recognize that growth in these aspects must be paid for in other respects.

So the question remains.  What is progress? and what’s it worth to you?

Read Full Post »

In Defense of The Question Is The Thing

I’ve oft been accused of being all vision with little to no practical finishing capability. That is, people see me as a philosopher not a doer. Perhaps a defense of myself and philosophy/approach isn’t necessary and the world is fine to have tacticians and philosophers and no one is very much put off by this.

I am not satisfied. The usual notion of doing and what is done and what constitutes application is misguided and misunderstood.

The universe is determined yet unpredictable (see complexity theory, cellular automota). Everything that happens and is has anticedents (see behaviorism, computation, physics). Initiatial conditions have dramatic effect on system behavior over time (see chaos theory). These three statements are roughly equivalent or at least very tightly related. And they form the basis of my defense of what it means to do.

“Now I’m not antiperformance, but I find it very precarious for a culture only to be able to measure performance and never be able to credit the questions themselves.” – Robert Irwin, page 90, seeing is forgetting the name of thing one sees

The Question Is The Thing! And by The Question that means the context or the situation or the environment or the purpose. and I don’t mean The Question or purpose as assigned by some absolute authority agent. It is the sense of a particular or relevative instance we consider a question. What is the question at hand?

Identifying and really asking the question at hand drives the activity to and fro. To do is to ask. The very act of seriously asking a question delivers the do, the completion. So what people mistake in me as “vision” is really an insatiable curiousity and need to ask the right question. To do without the question is nothing, it’s directionless motion and random walk. To seriously ask a question every detail of the context is important. To begin answering the question requires the environment to be staged and the materials provided for answers to emerge.

There is no real completion without a constant re-asking of the question. Does this answer the question? Did that answer the question?

So bring it to something a lot of people associate me with: web and software development. In the traditional sense I haven’t written a tremendous amount of code myself. Sure I’ve shipped lots of pet projects, chunks of enterprise systems, scripts here and there, and the occassional well crafted app and large scale system. There’s a view though that unless you wrote every line of code or contributed some brilliant algorithm line for line, you haven’t done anything. The fact is there’s a ton of code written every day on this planet and very little of it would i consider “doing something”. Most of it lacks a question, it’s not asking a question, a real, big, juicy, ambitious question.

Asking the question in software development requires setting the entire environment up to answer it. Literally the configuration of programmer desks, designer tools, lighting, communication cadence, resources, mixing styles and on and on. I do by asking the question and configuring the environment. The act of shipping software takes care of itself if the right question is seriously asked within an environment that let’s answers emerge.

Great questions tend to take the shape of How Does This Really Change the World for the User? What new capability does this give the world? How does this extend the ability of a user to X? What is the user trying to do in the world?

Great environments to birth answers are varied and don’t stay static. The tools, the materials all need to change per the unique nature of the question.

Often the question begs us to create less. Write less code. Tear code out. Leave things alone. Let time pass. Write documentation. Do anything but add more stuff that stuffs the answers further back.

The question and emergent answers aren’t timeless or stuck in time. The context changes the question or shape of the question may change.

Is this to say I’m anti shipping (or anti performance as Irwin put it)? No. Lets put it this way we move too much and ask too little and actual don’t change the world that much. Do the least amount to affect the most is more of what I think is the approach.

The question is The Thing much more than thing that results from work. The question has all the power. It starts and ends there.

Read Full Post »

As I watched some of the Republican National Convention, gear up for the DNC, get through my own daily work, read essays, strategize about business, talk to friends and family and synthesize all the data, I just come back to this question What Are We So Afraid Of?

I decided to write this post today specifically because I saw this ridiculous commercial yesterday for ADT Pulse.   http://www.adtpulse.com/  This commercial made it clear that if you aren’t monitoring your home in real time with video all the time everything you know and love was in grave danger!    So, I’ve decided to figure out just how afraid of everything I should be.

Here’s some of what we seem to be afraid about as a culture.

Our jobs: 

http://www.pewsocialtrends.org/2012/08/31/public-says-a-secure-job-is-the-ticket-to-the-middle-class/

http://www.cnbc.com/id/29275784/People_Fear_Losing_Job_the_Most_Poll

 

Our economy: 

http://www.conference-board.org/data/?CFID=20758670&CFTOKEN=9d689c13bda4ed14-4C556B63-968C-7A5F-C9BBEBCC03AA5B5E

http://pewresearch.org/pubs/2306/global-attitudes-economic-glum-crisis-capitalism-european-union-united-states-china-brazil-outlook-work-ethic-recession-satisfaction-gloomy

 

Our government: 

http://www.realclearpolitics.com/epolls/other/direction_of_country-902.html

http://www.people-press.org/2012/06/04/partisan-polarization-surges-in-bush-obama-years/

 

People different than us: 

http://www.sciencemag.org/content/336/6083/853.short

http://www.nyclu.org/news/nyclu-analysis-reveals-nypd-street-stops-soar-600-over-course-of-bloomberg-administration

http://www.winnipegfreepress.com/arts-and-life/entertainment/books/unfounded-fears-167413105.html

 

Murder:

http://www.psychologytoday.com/blog/the-narcissus-in-all-us/200903/mass-murder-is-nothing-fear

 

Food:

http://www.amazon.com/Fear-Food-History-Worry-about/dp/0226473740

http://shop.forksoverknives.com/Forks_Over_Knives_The_DVD_p/5000.htm

 

Technology and Media:

http://richardlouv.com/books/last-child/

http://www.amazon.com/You-Are-Not-Gadget-Manifesto/dp/0307269647

http://www.theatlantic.com/technology/archive/2011/12/5-things-we-fear-new-technologies-will-replace/250545/

 

Cancer, Disease:

http://www.lancet.com/journals/lancet/article/PIIS0140-6736%2810%2960610-1/fulltext

 

Medicine, Shots, Vaccines:

http://www.wired.com/magazine/2009/10/ff_waronscience/

 

God, Heaven and Hell:

http://www.plosone.org/article/info:doi/10.1371/journal.pone.0039048?imageURI=info:doi/10.1371/journal.pone.0039048.t001

http://www.usatoday.com/news/opinion/forum/2011-08-07-love-wins-afterlife-hell_n.htm

 

Terrorism:

http://blogs.tribune.com.pk/story/13262/london-olympics-2012-the-odds-of-dying-in-a-terrorist-attack/

 

Our Children’s Safety:

http://articles.chicagotribune.com/2011-07-17/news/ct-met-walk-alone-20110717_1_free-range-kids-abductions-york-writer-lenore-skenazy

http://www.denverpost.com/ci_16725742

 

Tattoos:

http://www.dailymail.co.uk/health/article-2032696/Now-tattoos-cancer-U-S-regulator-probes-fears-inks-contain-carcinogenic-chemicals.html

http://professional.wsj.com/article/SB10001424052702303933404577505192265987100.html?mg=reno64-wsj

http://cityroom.blogs.nytimes.com/2009/04/01/when-tattoos-hurt-job-prospects/

 

Large Hadron Collider:

http://www.time.com/time/health/article/0,8599,1838947,00.html

 

Everything else:

 

Nothing to Fear?

So is there anything to fear?   are the fears valid?  well, I guess they are valid fears if you don’t have information.   So here’s some information.

 

Most fears drilled into us aren’t founded on evidence – at least not at the level we fear them:

http://www.amazon.com/False-Alarm-Truth-About-Epidemic/dp/0471678694

http://www.amazon.com/The-Science-Fear-Culture-Manipulates/dp/0452295467/ref=pd_sim_sbs_b_2

 

Unemployment isn’t really that high in this country (or most western countries), especially if you get an education:

http://www.wolframalpha.com/input/?i=unemployment+rate+USA%2C+England

 

You’ll probably have 5-10 employers in your working lifetime so assume you’ll get laid off, fired or go out of business.  There will be other businesses to hire you or you can just make something yourself:

http://online.wsj.com/article/SB10001424052748704206804575468162805877990.html

 

Economy will have short term blips but ultimately continues to churn ahead:

http://www.wolframalpha.com/input/?i=gdp+usa

 

You’re unlikely to be murdered

http://www.wolframalpha.com/input/?i=crime+rates+in+austin%2Ctx

 

Children aren’t taken very often (at least in Colorado)

http://www.denverpost.com/portlet/article/html/imageDisplay.jsp?contentItemRelationshipId=3433817

 

In fact, violence has long been on the decline:

http://edge.org/conversation/mc2011-history-violence-pinker

 

It’s ok if you forget to pray, chances are it probably doesn’t change outcomes:

http://www.washingtonpost.com/wp-dyn/content/article/2006/03/23/AR2006032302177.html

 

And humans have been getting tattoos for a long time and the world hasn’t ended:

http://www.smithsonianmag.com/history-archaeology/tattoo.html

 

Oh, and, humans aren’t that different from Bonobos or Chimps, much less other humans.  So, maybe we should rethink that worrying about people that aren’t just like us:

http://www.dailymail.co.uk/sciencetech/article-2159027/Humans-share-genetic-code-endangered-ape-species-bonobo.html

 

Almost every one of common fears are unwound through perspective changes aka education aka realizing it’s not black and white.    Again, see the S. Pinker History of Violence link above to get an idea of the real impact of just literacy and access to information and what it does to fear.

Is it a big deal that people fear the wrong things?   Yes!   Especially if it leads to suicide bombing, racial profiling, not getting an education and so on.

 

But, c’mon, aren’t there some things we should fear?

Maybe…

http://www.huffingtonpost.com/david-ropeik/fear-of-climate-change-ma_b_1665019.html

and maybe this too

http://www.foxbusiness.com/personal-finance/2010/09/20/student-loan-debt-surpasses-credit-card-debt/

well maybe this too

http://www.cbsnews.com/2100-201_162-628194.html

 

In the end, methinks fearing too much is a waste of time because in the end we just don’t know what’s going to happen, right?

http://en.wikipedia.org/wiki/Black_swan_theory

Knowing you can’t predict it all (thus prevent it) what’s the point in worrying to the point of being truly scared?

http://mathworld.wolfram.com/ComputationalIrreducibility.html

 

So, no, ADT, I won’t be buying your Pulse product.

 

 

Read Full Post »

Some people hate buzzwords, like Big Data.   I’m ok with it.  Because unlike many buzzwords it actually kind of describes exactly what it should.   It’s a world increasingly dependent on algorithmic decision making, data trails, profiles, digital finger prints, anomaly tracking… not everything we do is tracked, but enough is that it definitely exceeds our ability to process it and do genuinely useful things with it.

Now, is it because of the tools/technology that makes Big Data so challenging to businesses?   I suppose somewhat.  I think it it’s more behavioral than anything.  Humans are very good at intuitive pattern recognition.   We’re taking in Big Data every second – through our senses, working around our neural systems and so on.    We do it this without being “aware”.   With explicit Data Collection and explicit Analysis like we do in business we betray our intuitions or rather our intuition betrays us.

How so?

We often go spelunking through big data intuiting things that aren’t real.  We’re collecting so much data that it’s pretty easy to find patterns, whether they matter or not.  We’re so convinced there’s something to find there, we often Invent A Pattern.

With the ability to collect so much data our intuition tells us if we collect more data we’ll find more patterns.  Just Keep Collecting.

And then!  we have another problem.   we’re somewhat limited by our explicit training.

We’re so accustomed to certain interfaces with explicitly collected data – Spreadsheets, Relational Database GUIs, Stats programs, that we find it hard to imagine working with data in any other way.   We’re not very good at transcoding data into more useful forms and our tools weren’t really built to make that easier.   We’re now running into this “A Picture is Worth a Thousand Words” or some version of Computational Irreducibility.   Our training has taught us to go looking for shortcuts or formulas to compress Big Data into Little Formula (you know take a dataset of 18 variables and reduce it to a 2-axis chart with an up and to the right linear regression line).

Fact is, that’s just not how it works.   Sometimes Big Data needs a Big Picture cause it’s a really complicated network of interactions.  Or it needs a full simulation and so on.

Another way to put this… businesses are so accustomed to the idea of Explainability.   Businesses thrive on Business Plans, Forecasts, etc.   so they force a overly simplistic reductionist analysis of the business and drive everything against that type of plan.   Driving against that type of plan ends up shaping internal tools and products to be equally reductionist.

To get the most out of Big Data we literally have to retrain ourselves against our deepest built in approaches to data collection and analysis.   First, don’t get caught up in specific toolsets.   Re-imagine what it means to analyze data.   How can we transcode data into a different picture that illuminates real, useful patterns without reducing it to patterns we can explain?

Sometimes, the best way to do this is to give away the data to hoards and hoards of humans and see what crafty things they do with it.  Then step back and see how it all fits together.

I believe this is what Facebook has done.  Rather than analyze the graph endlessly for their own product dev efforts, they gave the graph out to others and saw what they created with it.   That has been a far more efficient, parallel processing of that data.

It’s almost like flipping the idea of data analysis and business planning on its head.   You figure out what the data “means” by seeing how people put it to use in whatever ways they like.

Read Full Post »

After a TechCrunch article writer by Sarah Lacy posted August 22, 2011

A few months ago Sarah Lacy, a TechCrunch.com writerwas giving a talk in her hometown of Memphis, TN, and someone asked what the city could do to ignite more entrepreneurship among inner city kids. Her immediate answer was to teach coding– even basic app building skills– along with English and Math in every public school. She was surprised that her brother– an engineer who worked for many years in Silicon Valley before relocating to the Midwest– didn’t necessarily agree.

The thing is that while this is a first level issue of who gets the jobs needed in coding – foreign or domestic coders, it occurred to me that we are in the 30th year or so of serious code writing and it has had some unanticipated consequences.  The changes in the world that have been brought about by the Internet and technology have changed what is done by people.  Now, more and more what is done is done by software applied to different technologies.  The world of TechCrunch and other quasi-geek clusters are alive and well due to the prevalence of algorithms.  They are the workers in a mired of different ways today.

They paint the cars, cut the steel, do the book binding, print the content, answer the phone and a zillion other things that we all used to do.  In a cumulative way the jobs that were are now being done by technology just like was the case when ol’ Ned Lud (see emphatic published accounts for the most favorite spelling…) brought to mythical status between 1779 and 1812 that changes in British textile practices were coming to a screeching halt.

No, I am not being Luddite here.  I am simply pointing out that, when all the talking heads whine and moan about this political union or that political union not producing jobs for the reconstitution of the economy, they should take note; the jobs in the past that went away aren’t coming back.   Many of them aren’t coming back due to being  long overdue to be absorbed before the downturn and no one – or not many, took notice.

Instead of asking for someone else to provide jobs, it is time to create jobs based on that uncomfortable situation that we find ourselves in every 70-90 years.  Change has overtaken the status quo.  Now we need to create jobs that machines can’t do – yet.  That is, jobs involving organizing communities, infrastructure, law, education and human-care… for children, for families in transition, for elders and for soldiers who are brought back and deposited on the steps of America.  They were taught how to do what was necessary to what they had to do to survive.  Nowhere is the training they get any better for that purpose.  Now however, they have done that under duress, for double tours, etc. etc. etc.  To be spit out by those that trained them as worn out and disposable civilians with defects without the slightest bit of care on how to survive reestablish domestic values, is despicable.  Software and algorithms can’t pull that off.  We can if we stop waiting for someone else to do something we favor or don’t find dogmatically repugnant.

HP’s decision to go big and purchase the U.K.’s Autonomy Corp., and probably other players doesn’t seem so ridiculous under a ‘software good – hardware sad’ scenario, does it.

Read Full Post »

UPDATE: I missed SWs blog post.  Brilliant!

Early versions of this approach go back nearly 50 years, to the first phase of artificial intelligence research. And incremental progress has been made—notably as tracked for the past 20 years in the annual TREC (Text Retrieval Conference) question answering competition. IBM’s Jeopardy system is very much in this tradition—though with more sophisticated systems engineering, and with special features aimed at the particular (complex) task of competing on Jeopardy.

Wolfram|Alpha is a completely different kind of thing—something much more radical, based on a quite different paradigm. The key point is that Wolfram|Alpha is not dealing with documents, or anything derived from them. Instead, it is dealing directly with raw, precise, computable knowledge. And what’s inside it is not statistical representations of text, but actual representations of knowledge.

 

Maybe you’ve seen the latest NOVA episode about Watson, the AI machine that played Jeopardy against former champions.

The first blush answer would be: NO.

The linguistics are simply not there yet.

However, if Jeopardy questions were more “computational” vs. linguistic and fact retrivial the answer might be: YES.

Wolfram|Alpha has the raw power to do it, but it lacks the data and linguistic system to do it.

IBM was clever to combine the history of Jeopardy questions with tons of documents.    It’s similar, but not the same as, common sense engine from Cyc.    It’s not fully computational knowledge.  It’s semantic.   It’s cleverness comes from the depth of the question training set and the document training set.

It would breakdown quickly if it were seeing questions about facts that had never been printed in a document before.   An example would be “How far away will the moon be tomorrow?”

Wolfram|Alpha can answer that!   Now, what’s challenging is that there is a much bigger universe of questions that have never been asked than those that have!   So Wolfram|Alpha already has far more knowledge.   However, its linguistics are not strong enough to clearly demonstrate that AND it will probably never catch up!   Because Wolfram|Alpha can answer questions that have never been asked so people will always ask it questions that will trip it up… they will always push the linguistics.

In the end, a combination of Watson, Wolfram|Alpha and Cyc could be very fun indeed!

Perhaps we should hack that up?

Read Full Post »

Older Posts »