Neuroscientist and musician Don Vaughn (donvaughn.com/) discusses the basics of Arduino processing (arduino.cc/) and how you can create great interactive gadgets in your own garage!

https://www.tendenci.com

 

 So you've heard from

Creative wordpress and drupal and you just heard from J-Money about how to make smart websites

Yeah, right. Hey

I don't know

I thought that some of that stuff is pretty money so so J-Money taught us some of that

this is not going to seem directly related to that, but I'm going to talk to you about to open source platforms for

Controlling graphics and controlling hardware, and it doesn't seem [like] it's maybe related to web stuff

And it's not directly but but I think I'll be able to show you over the course of this talk

Is that you can use both [of] these things to?

Augment things you're doing online and also do create a project. So just by a show of hands. How many people here are coders

Well, how many people here quickly marketing?

Okay, and how many people are just hobbyists and like tinkering with stuff?

Yeah, cool. All right. So my goal. Is that mah eyes time is valuable, and I will have little tidbits

I think I put this presentation that will address all those things, so

processing an Arduino is really just a shortcut for

you know there are platforms that are just about graphics and hardware and

So I'll talk about processing first and what processing is is it is a language that has been?

Created through an open source community has lots of contributions a very active user base

and which allows you to do is easily manipulate graphics great animations and

also, do cool interactions with users

So they can you know over the internet or if you have an application written on your laptop, and you're at a conference

They can interact a bit and change the displays in with only actually a few lines of code they boiled it down

But it's just the bare bones stuff and what I'm going to show you is in less than five [minutes]

We'll get something up and running

It's really interesting and stunning, but you don't have to write a single line of code

And then as we progress through the talk, I'll give more advanced examples, so I think people who are interested marketing

You'll see some ideas on how you can tie that in because this is both of these platforms are really all about prototyping

quickly and efficiently, it's about you coming up an idea like I'd really like to show a video of

This [particular] thing that my company does and then maybe do some cool graphics with it

Or I want to show a photo and do something with that in you hear me cool. [okay], so

But these are this is obvious on a more advanced and the spectrum, but these are very interesting graphic in tribulations

This person is let's put it together. It's a large project

But this I tried to explain what processing was my girlfriend, and she gave me the blank their best

So I thought this would be a much more easy to show you what you can do

Interacting the touchscreen and producing results quite. I don't [like] that music tracks out for it

So that's one way that's really how processing can allow you to

Do cool art projects and copy type stuff without knowing too much about what's going on

This is obviously the more advanced side, so then for those of you. Who are in web marketing

I'm a scientist, and I'm really interested in

How you can visualize data and effective ways we do

I work at David Evans lab at Baylor College of medicine and we're about setting human perception

So we put you in an FMRI machine and we scan your brain while we show you particular stimuli

And then we see what sliding up

And you know what's correlating and how is it that that three-pound thing in your head is constructing full reality

So you know we divide the brain into fifty thousand small little pieces

And we see how one piece is talking to another one is you can imagine that's really highly dimensional space how you can effectively visualize

Stuff it's really important

What processing is able to do is with?

[its] open source

Software there's a lot of toolboxes that you can quickly use to effectively show the kinds of data that you [have]

And are interested in displaying this example right here. I think is directly related

It's all about web marketing and how you can track links, and how users follow them, and then what the effect is it's called Cascade

Is not blame them?

Mention just the headline in the link but many offer a short explanation or princess this whole things are

addresses Data Further

What they're doing, is they're taking?

The Bixie doing a 3D map of how people paul link, so this is the streak over time 16 hours

Emphasis took a host to link. What happens is our Twitter feeds out there

And how it is that?

You know it's something that's difficult to understand given. How many things are going on so with processing helps you do is

Visualize that and so this is again more on the advanced side

But I just want to give you guys quick introduction on what's possible if you spend some time with this software

But what I'm going to do now is I'm going to give you a couple quick examples. I said within five minutes

We'll get something up and running so let's do that

processing here, okay

So one of the is with the Ide the id looks like you go to processing org, and you can download it and work?

awesome

well, let me just

do the shortcut because I'm sick of

That cool hopefully this works on two screens. I'm okay. So this is what processing looks like you can download it

I think you guys are on Facebook or something's I don't want to rely on actually showing you that

you can open up a sketch by going to the bow many of you can't see and

Look for examples. That's hold on let me see if I can solve that

That's better. Let's see if that works okay, so

Anyways, you're looking at processing you can go to file and a quick side note is all the programs that you writer called sketches which?

Is really?

Show you that what this is about is sketching up ideas. It's about thinking something

Oh, I've really want to see generally this kind of visualization

How quickly can I just mock it up? And if I really like what's going on?

You can hire [someone] to do it more professionally or sometimes as I'll show you later. It's good enough

So you can look at all these examples that are built in right?

There's ways to message the camera, and that's what we're going to do

we're going to take the live feed from the camera and

Run a threshold an algorithm on it that this entire piece of software is built in I didn't write a single line of this code

So let's see if this works

Cool

So it basically turns

me in the black and white image in real time and

When I you can mess with the threshold and do various manipulations. It's a really easy way to

It is a really easy way to start learning how to code if you don't you can look in here and kind of look

What's going on?

Maybe see something called threshold, and I decide I want to change that and make it higher, so it'll change the output

to go

Very forgiving language, so now the threshold for turning things white is changed so you can get a different output

And so you customize that immediately?

when I saw this

My friend introduces to me and I thought that is

Something I really want I'm a drummer, and I perform live with DJS and what?

Half of the performances is about making great music and we play a lot of clubs

but also what's lacking from a lot of performances that I want to incorporate was how do you make really cool audio visual stuff and

this hit the spot there's

647 Built-in algorithms for taking video, and so well, I amalgamated them all into one program, and then added some code in my own and

Got the following

you

cool, so this is just taking the

raw video and displaying it and then you can write an algorithm this one is called frame differencing and

What it does is it takes the difference between one frame in the next frame and this example is also in

Processing just copy cut it paste it

And so if there's no change going on you don't see anything, but if you move around then you can just see what the differences

So as you can imagine when you're performing live and moving around on the drums or DJ scratching

That's a really cool effect [that] you can add in without again without really doing much at all so I

Think there's a couple other ones on here. You can do cool artwork

This one this one was included in processing as well where it takes each pixel it takes an average value and then rotates it randomly

You can do monochromatic

Things where it takes you know depending how bright something is it'll change the output in the size of these squares

We have a question

Okay, yeah, if you guys have questions feel free to just ask those were going along

I mean

We're going to go through one example in

[just] [a] couple [minutes] war will start kind of from scratch the idea that we had and see if we can build up something

That's another example. That's actually you can't see it because the monitor size is kind of funny

But again, if you want to do some marketing with that you can have an application

Put that on there the visuals attract people's attention

And then I have my logo

When it works in the bottom right and so you can again people are really drawn to that

It's really effective people. Do people always ask me afterwards

We're can I buy that software it's really cool, and I want to take credit for but I say you know

I this is mostly open source with a couple modifications

And it took me about 20 [minutes]. You know maybe with some code changes

So that is a quick example of doing absolutely no changes and getting cool [result] now

I'll show you a one quick example where [we] can look at a program will just change out one file and

Four and it'll take the same effect and just modify it slightly so what we're going to do is we're going to take

this thing called explode

Again, this is you can find it in processing to sit file example, and it's in there and this

We'll take this image

this is an image of my neuroscience lab and as you move the cursor across it'll explode Outward and a cool visual effect, so

[immediate] when I saw this I thought

You know if you have an idea you want to I really want to see what something looks like with a quick explosion of this

Picture with our logo at the end of a movie or whatever

boom

Go without writing any code. All you do is sub in the name of your image that you want that it loads

And it'll do the same quick algorithm on it. So I thought that was really cool and really

Easy to do without knowing too much at all

Now I want to get into a couple more advanced examples this

You can also take video feeds

stuff you recorded

This one if you want you can quickly take some video on your iphone

sub it in and that you can run some algorithms on this one's called pixelate and it takes a

Video stream, and it just drops it up into this screen sizes so small

Okay, well this is an image of a train going by and this is a quick algorithm that chops it up into tiny little blocks

And then presents it back to you, so you could do that with anything

there's a bunch of if you explore a bunch of examples on this and

What I found was amazing about processing is some of the things that I wanted to do that

Weren't immediately in the example program. You can do a quick search online and figure out a way that somebody's already done to modify or

again to just make some quick changes to things that already been done, so

In the neuroscience lab we are interested in how people receive reality, and there's this one illusion called

the herring illusion and what we find illusions to be interesting is because

there are really great examples of when

Your brain is perceiving reality, but it's it's clearly doing it in a way that

that isn't consistent with what you is actually out there in the real world, so this is called the herring illusion and

By show of hands. How many people see this part is bent

Now when you see the two lines [is] straight

Okay, cool. Well the they're actually straight in real life, but

[your] brain perceives them as bowed Outward kind of looking

More like an oval and so we're interested in why why is that it such as striking difference from what's actually drawn on there?

so there's a couple theories on this and one of them is based on the idea that you're constantly living in the past, so

When light hits your retina. It's got to go you know through optic nerve and then go through LG N

And then go to the back of your brain which is where your visual?

responses and by that time

It's about 100 milliseconds later

So you're living a hundred milliseconds in the past all the visual information see?

Doesn't get processed until about that much later by a tenth of a second might not seem like a lot

but you can imagine if you're playing baseball or

You know you're hitting a 95 mile an hour fastball or playing football or you know running from a cheetah and the African plains then

That's going to be an issue

So you're gonna be off by several feet if it's baseball and you might get eaten if it's a cheetah or hit a tree

So what we think your brain does is it?

Extrapolates Ford about 100 milliseconds projecting what it thinks you're going to see in the next scene and so what this illusion would suggest is

If you see all the radially expanding lines out there, that's oh

we think is a signal of optic flow which is when you're moving forward through the world and

Everything is kind of streaking by you so that's what the radio lines represent. So what we want to do if [that] is the case

In the next scene you'd have these parallel bars in front of you

And you need to move if you move forward they look a little bit bowed out

Like they do in the hearing illusion, so we got curious

maybe

We can replace these

Static Radio Lines with an actual optic flow pattern so you know stars like a star field like the crappy screensaver from Like Windows 95

So if you get that do you see the same illusion?

And I mean the way I thought we [just] need to mock up a quick graphical thing. This is great for processing so

the excess presentation

you go to processing org, and I thought maybe someone has

Already built some kind of star field. This is what the website looks like they searched starve

Right there, it is somebody's already built all look for a star field

What I want to do is now, we have this idea. Let's copy this all this code

And unlike you know

Almost everything on computers

The code just seems to work the first time it's cross-Platform. It works in Mac

Linux and windows and so unlike powerpoint when you move it from one computer and like your images are all jumbled or something

And doesn't work usually a processing there it is

That's great. So you can hop online and do any kind of search for something your student?

There's usually some kind of open source code out there, so this is the code

I end up using which is a star-filled going by to represent

optic flow and

Now all we want to do is we want to add a couple lines on there

Like I want to represent those herring bars again those parallel bars. So what I want to do is then

You can see it basically execute this command over and over again

It's called Draw and so every time draw a black background and then draw a bunch of stars

That's all it's doing over and over and over again. So what I want to do. Is there's a command

Levis Hardware hacking, we're Gonna use this as my stan?

I'll up here

Okay

There's a cool reference manual, but just simple function is called wrecked, and you draw you know where I want it on it

100 Hundred and I want to be like 20 pixels wide and I don't know 21 pixels long. Let's see what that looks like

Take we took it was just working we can add a simple thing okay get in there

so the background is changing limits so let's

Is also command called [fill] and these are all easily I said available on the front page of processing website now

Let's see we got go

Well, there's one line you can imagine that you know f about 15 minutes later

I can easily mock-up a prototype of exactly what I want to present two subjects. Maybe move this bar over a little bit

pretty close

so I have a moving star field which is what we wanted to represent optic flow like you're moving to the world and then we

Wanted to see now if we put these parallel bars in front do we see the herring illusion still

I don't see it on this one, but let me go to the website version

code up

and

Processing is run with Java

So if any that's very easy to look at across web ok well, the display is not gonna work, right?

But you have to take my word for it

You can kind of see the bars coming up that we have a star-filled

It's flowing and then we have two bars popping up and we were able to

Use this and we this is exactly what use for our study, so in my lab

We just wrote a paper where we presented subjects with the stimuli

Banding in contracting motion put some bars up there we found a positive result

We've ran the whole thing in processing logged all the data took me, you know

Maybe a couple hours to do everything and then we are going to submit to Nature neuroscience this week

So it doesn't always necessarily have to be that. It's just for mocking a project you can always end up using it

Is your final version some cases?

Yeah, and the crappiness of my placement of those bars, but yes, it's pretty the width of it

You can see in the in the original illusion

They're pretty thin I just want to see to show you that you can start with an idea

Look online

Amazing open source community with lots of contributions grab something make a couple quick modification using some basic

Functions like I draw a rectangle. Yes. Can I change the color yes? It's gonna make them flash, huh pretty easy

So that is essentially what you can just one example of how I've use processing

I'll give you another example and actually use it to control the drumset that I'll show you guys

But that's kind of the end of what I want to talk about for processing are there any questions specifically related to that

Yep

well if you're a scientist, you use it to run an experiment, but it like I said it's

This is for I think visualizing data is an amazing example of how you can use this it's really

Really fast and good like that star-filled

it does it in a way that a lot of languages can't do easily it creates a bunch of actual like objects as

Able to make them go through time at you know a frame rate of 60 Hertz which

Is pretty quick if I try to do the same thing in Matlab or another?

Language it would take me a long time to get that to work properly

Yeah, what's up? Yeah?

The tread No the treadmill one

you

Hmm. I mean, it's impossible to know without seeing it what language it was written in

Really anything you can think of [that] you wanted to quickly mock up graphically is able

You're able to do in processing like I said that kind of that first example

I showed is more in the advanced and we're taking user input mess around with it and having all these complex

Interactions come out of it without too much else on your end

But I could I mean it could be final cut could be adobe premiere. I don't know

Huh, oh, cool

Interesting I think you could probably mark that up pretty I mean that's exactly a great example of what you would want processing for I

Have this idea

Let me see if I can mock something up and instead of drawing rectangle

Maybe you have an image that looks like a person and you can just quickly tile it up there in the shape of whatever ascii

Text but you entered there. Well if we want we can talk about afterwards, but there's I think that exact program

I'm not in the shapes of people, but you put in text, and it'll do cool manipulations based on what you put

Any all some processing?

great that's

lost over that I was going to show you the end but

So it's extremely

Easy it just I'm amazed with this program because it just works like you copy code off the internet

And it works

And I switch it from my PC to Mac and it works and what I want to export something you can let's export our

Crappy hearing illusion

sure

Okay, so it'll write it to

See save it as a sketch. We can make it for whatever platform while let's make it for Mac. Full, so then it

Should such a quick application

Executable, so now it works

With full screen and so you the export options are to it. I don't know what the extension is on that

On windows, I think it's an exe and on mac os what is that a pP? It's just a nap or you can

And we say export and we get ready for the net and then it exports all the files you need

I don't have my filezilla by just uploaded to my server, and that's where I got the herring illusion that was slow

But online and just just copy and paste it up there, and it works based on Java see the job in Jar files

you

Emma

No

Cool. I'm going to transition then and go into

Something slightly different which will look very similar. I think two lots of you, but it's called Arduino and

This is an Arduino

Arduino is

hardware

for controlling other hardware in an easy way, so

you have basically a bunch of input pins and output pins, and that's and

The ability to do processing on whatever your inputs and outputs are and that's really a little circuit

Is its do I want to read Data off a sensor? That's your input read it

Oh, if it's really high then do something or I want to turn on the led or turn [on] a toaster

I mean, that's what I we're just learned with this puzzle exploding and turn on a toaster

And I actually wanted to show you guys that but there's some guy who made a website where you can go to

His website and vote on what kind of toast he should have you know how crispy you want it and then the next morning

It'll turn on is toaster and cook it for him based on input, so so that's good

So I'm going to start with the least useful for society things

And then I'm going to build up or and hopefully end with something that is an example of how

really the way that Arduino and processing has lowered the

barriers to Entry for everyone to

Do projects that they think are cool either for our tour for social good and the consequence of that is that you really you get?

Some amazing and easy

applications and examples of social good happening with like a forty-dollar

Arduino board, and I think it's 30 now, but so I'll start with the toaster example example

which is really you know the worst one, and then we'll move up so here's the hearing illusion or so that

Okay, so here's another example

Slightly more useful if that you can see right here. This is action Arduino board that's attached to some PVC creature lights off

I'll hack in the dark

Okay, well and what he has it. He has attached to his door Deadbolt and

I we have a probably attached to work or

and the powers on

Our door is locked if somebody comes by and is it right there? Huh?

Nothing happens, but they come by and give the secret up

Yet, so this is just a simple way of taking Arduino and absolute

Put from something it's called a piezo electric device. Which is transmits?

Force into an electric signal you read it on here

And then you write a little piece of code any posts all this online you can make one of these tomorrow if you want

after the end of Ship will con and

And then it takes it puts an output pin and says hey turn this motor on that turns in unlocks a door

I mean, it's it's simple

and it's really easy to mock up and the codes already there and

Like a lot of Arduino projects the entire steps on how to make something like this or vailable online

But what I want to do is I'll present some examples of increasingly

You know maybe some more importance, but hopefully it'll inspire you to come up with oh

I never thought that you know it was a project heading back my head and never know how to go about to approach building it

and hopefully this will inspire you to say you can either do with Arduino or processing or some other open source language, so

That's one example of Arduino. I know some of you guys are into robots or RC helicopters. This is a

this is a a

self-balancing robots like a little segue so it cruises around there's a video for but I don't we [don't] have time [for] it and

If it starts to sense its tipping one direction there's a little accelerometer on there, and it'll just move it more in that direction

So it actually is quite effective. [it's] staying upright which I think is really cool

Know what else we have I don't wanna show you that one yet?

Ok so now they have given you a couple quick examples on what we can do. I want to

Close this and I want to start doing some hacking. Oh go away

oh

Screen thing is miserable

Alright, we're done with processing

And we need to look or what Arduino sketch. We're gonna do oh let's use this one first

you

okay, so this is built in with

You notice it doesn't look much different the processing so again you can go to file look for examples

There's a whole host of things from just turning the Arduino to make an Led blink or sending Midi stuff

getting data from Sensors

There's knock is actually there's all the code from that knock sensor that I showed you that opens the deadbolts

And there's a whole host of examples this one is

How to you can actually load audio files on your Arduino and play it

So if you want to make a custom door knock or something and you can go ahead and do that. All you need is

your arduino

here
Can you guys hear me like this I?

Might just [do] that. I don't think I can fiddle with this hardware and put your lights back on oh

you're going to

you

Plug it in

Light on to get a power lights something and then go

Catch it's our tools

And you want to know there's all sorts of different types of quartz you can have some of them have Built-in Wi-Fi cards

Actually, you've got to make wireless

And then others absolutely pad which put on your clothing so right on. Oh, why early F1. Oh

Louise want to make sure it's on the seal report yep, [okay], so we opened up our sketch upload

Uploading the board lights going off

done uploading so now

Now that the sketches on here. It's actually running this thing over and over again

Let's see what the pinouts look like a dome speaker on open

For all the athens stereo Jack we can plug it

on

They're all label

you

like

You okay?

back plug in this

here

Let's be quiet

you

Now I'm gonna start my okay

Awesome. Oh, you can make really advanced melodies really quickly

which is helpful, so I mean you maybe you think that's useful for a door knocker, but

That's just built in you can now take this and modify and say oh, no if you look down to sketch

What's going on here? [okay]? They're playing [a] see 4g 3g. Three. Maybe you have a song you've crafted [e]

As a doorknob, I don't know when someone walks in your room that just goes off and this fun cool

That's one quick example. So that's using Arduino as a stereo done with that one

you

So this actually didn't use a sensor. This was just you

Here's the sketch starts wait. I don't know two seconds, and then play this melody and don't play it again

so if you want to do a sensor

They're great. I

The piezo-electric. I showed you with the with a knocking how that works knock and

Exeter sensor goes off. That's what I use from that's what all electronic drum

I

happy

so either when knocking you definitely get up or

I'll show you later. We're a good example in a couple of slides. Where you actually laser

It has all custom, but the timing on this thing is accurate all it's doing is running

occupied

ok cool, so

Now I want to show you one other quick example, which is

operating leds I

Love leds so all we're going to do is we're going to this sketch is called blink again. This is right on the Arduino

All it's going to do is turn the led on for a second and then turn it off

leds

you

round

Well bolts the other thing that's cool about how do we know is it works on transit project. Which is typically 5 volts plugin?

now I got 12 volts, so

You so this sketch that has turned pin 13 on off. So why don't I upload this?

you

Yes, great [question] yes cool

so one second

Ashley

Haven't had it plugged

You cool

Sections we saw before they turn to spin on an office

now we have

take this expand upon it a bunch of

set of colors or a whole set of leds and since I am a

How do you start from a current slide?

Yes

oh

So awesome so just using Arduino in the pin out so you can just say turn this led on it this time turn this one

Off turn this one on turn this one off, and you [can] make

What he has enough 50 leds about 500 and you can just index them in and do whatever whatever comes your mind

So if you want to heat is for Halloween costume, [I] thought [that] was pretty cool pretty groovy

um

Ok, so this is maybe something. I actually can expect I was looking around for cool Arduino projects

That would show you guys that you might find a quick bowl. Just across a whole wide variety of things

With this is this is using the Arduino and using a laser that whenever something Krotz breaks this threshold I

Want to trigger the flash on my camera take a photo?

So this is how you can do really really precise timing and slow motion capture. He's actually popping a balloon in that top one I've

Never seen that poor and the bottom one is probably milk dropping. You're like that

It's quite simple to do you just say you know bree didn't put off this laser read. It read it read it

Actually the schematic. It's you know if with a lot of open source stuff. You're typically dealing with

not the best schematics

But you have an Arduino you got one pin

You wouldn't even need to know how electronics really work to get this to operate like this

It's really that simple you get a laser whenever you break it and the photoresistor doesn't isn't getting the signal from the laser

Trigger the camera

That's pretty cool. I thought that was an interesting application. [I] hadn't seen before

Okay, one more example before I get to some more advanced stuff. That's built in is this midi thing. Where you essentially are

Turning your Arduino into a Midi device where it's sending out Midi notes

Well, let me upload this really quick to Arduino

And what's going to happen is it's going to play a scale

It's going to play a whole bunch of mini notes going up and the whole bunch of me now

it's going down and if you want to connect it to your computer you can get a cable or

things about 10 bucks

Then uploading great. Give me a sec

So all that's going on here is you want have cereal pan on your Arduino?

You one side where were you?

Three pins you want power round and whatever your Midi

You are we by bolts

Brown ground

Lastly, what is it say pins that okay Pin 5?

Now hopefully we're getting any signal let's

So we're sarga Raj ban and hopefully we'll hear a scale of piano notes coming from the Arduino you

Okay, let me restart

Nope hold on

I'm determined that every example. Yeah

Cool, so you just turn your Arduino into a midi device. It's now sending midi notes, and it's triggering a piano sound

You can map it to whatever you want smokey clav

everyone

Okay, that's enough

Okay, so there's actually a cool example of someone online who made a laser harp

This is like one of the core Arduino projects where he has lasers coming up?

And you tap any of them and it triggers a mini note, so that's actually what I've done with my drum

Set is I'm using Arduino as a drum brain for this whole thing where when you tap any of these drums

Send a little voltage signal the Arduino read it if it's higher than a certain level that was a hit

Let's send a Midi note equal to that

So I will show you that in a second, but first I want to get to the the one really cool um

social good thing I think that's going on with this is this is a

He's 13 he's in chile and after they had some bad earthquakes he as you can see in the bottom left

He simply hooked up his home earthquake detector to an Arduino and whenever a God above a certain level

Detecting a seismic quake it would over this land

There's Arduino does it come with lan ports interface with his computer get on the Twitter api and send out his tweets

So everyone would have an instant notice and he's able to these detected every single earthquake since may and this is you know [a] [bull]

Thirty dollar piece of software and this is exact what I'm talking about where when you lower the bar on

Accessing these powerful and quickly you know sketch abul

Ideas you can get these

interesting ideas that you know most people don't think of you have this wide distribution and brains on the planet and the best way to

Get the most good is to let everyone be as creative as they can

okay, and

You know I think I'm going to skip maybe I'll skip the drum thing

But what I do want to talk about is something a current project that my lab is working on and this is

how

Can you get?

Senses into people [who] have lost them, so if you're blind

And you've lost sight or maybe [you're] congenitally blind you never had it. How can we take?

visual information and

feed that in through another mechanism, so

This is called Sensory substitution and one example. We've already written an app for this is you take your iphone and you can

cruise around the room and then we run a bunch of visual information algorithms on it to

see if you can detect lines that are there or anything, it's able to help someone navigate so you might like and

You're feeding it into auditory channels

So it's like taking visual information

Transmitting it and what the brain is really good at is wrapping itself around. Whatever kind of Data you you send it

I mean, it's totally random that we happen to have eyeballs that take

Electromagnetic radiation or that you have eardrums that take air compression waves?

I mean, we could be a lobster and have magnetic senses, but we don't and that's just out it

So the question is in the future not only can we substitute senses, but can we add different senses

so we have some projects in the lab where [we] take visual information, and you feed it haptic lee through your

body and see if you can you if you if that's meaningful, if you can translate that into something

So I came up with the idea of using an Arduino to this project

Where I'm Gonna take Joy

No

And [heaters] are not working, okay?

what I have on the top of this right here is called a ping and it is a

Ultrasonic sensor, and it so it's admitting

Pulses above the frequency at which you're able to hear forty thousand hertz and then it receives the bounce back and it says how long

Did that take it took a long time than the objects far away and use you get to closer objects?

It's much more mediate. So you can tell distance. You're basically doing echolocation

the question is can I take this and

feed it to someone as any kind of other information whether it's

Auditory or in this case. We're going to use touch and can that help people navigate

So let me mock-up this I marked up equip sketch. There's I?

Googled

the ping controller, and there was of course and immediately an Arduino hit for

Controlling the singing calculating distance which is right here, and I added a couple lines code that then translate that right here in to

Output for this motor pin, so let me wire this up. Give me another 20 seconds and will and I'll show you this device

So again all you do plug in Arduino [you] are

You are here. I actually wrote this sketch on a PC

So it's never been uploaded on a mac on my dropbox, but I have full faith that Arduino will handle it hopefully

Yes, okay?

Right so now all we have to do is wire up the simple piece of hardware. We need 5 volts here

Own that's over here, and then we need one pan. What does it say on here, okay?

[we] need digital pins seven hooked up to the signal line you

in seven

Okay

Yep, that's working now sending

Arsenic pulses and it's feeding the information Arduino now what we want to do is we want to that's our input. I?

Brought up people own motor this and I'm going to map this

22 seconds I want to map this to just the output so I'm sending everything to pin

Pin Pin 7

Think it's three yeah, okay great. So I think she could work right now

Cool. Yeah, okay. Great. It's working so we mike's you can say so so there's nothing in front of me

They don't hear anything from this motor and as I

Start to put it towards objects

Close she gets an object get further away, you got nothing going on

Get closer again, so yeah, and this you put your hand in front of it, obviously goes nuts

So what this allows you to show is [that]?

This is something that we've now started test on blind people and it is helping them in

Navigating the world so we had someone come in yesterday

And they and I walked around with it and just we're able to detect walls mean

It's pretty obvious removal all in front of you

Have a sensor that day, and you can do it at longer ranges than canes and also

We you know we want to get rid of this you know that maybe there's a stigma there

And so if you can have some walk around and feel a little bit more normal now

I have to use a cane and sense things at part of the positive distances

That's awesome, and you're able to mark the stuff with three wires and like a thirty-dollar sensor

So I hope I've been able to convince you guys that

Arduino and processing are

Super easy to use there's lots of examples out there

and what they're able to do is let people fully embrace your creativity and

Do good things with that creativity or just think thanks

I

Think we only have like very two minutes then have any questions

But what like how hard you hit it, huh?

Yeah, you know if you want to stay around afterwards. I'll show it, but I just there's so many cool examples

I want to show I mean in

20 minutes, we made a stereo a Midi controller

and

Led Controller A

Haptic a little object and then if we had a couple of minutes, I'd make him do a drum brain

I think that's you know for a 30 dog. He's hardware that's extremely flexible

Really easy. I mean I let's go through we can bring the last couple minutes will to show you a couple

Okay, all you I mean, this is just so you can communicate with it

You don't even really need this okay, so all I'm doing is

I'll use my drum controller

Okay, all I'm doing is

Every time I go this loop called loop and I just say what time is it okay?

Did I send any commands to it is like what I want to do is when I'm basically

interfacing processing and Arduino together in this cool little nexus where you can I can press keys on my

Laptop and it turns on lights on off of my drumset or change modes from flashing to on or whatever goes checking their but?

some of the most basic stuff is

Okay

Hit Detection, okay cool so check what's going on? Here's my velocity it's

Did I get a midi note and is and what is the velocity of it okay? Now? If there was a hit?

Then change the color on all the led pins, and we do is either something called analog right, and you just right

No

This is on or off and how on or off it can turn a little bit you can do fades with it or something called

Digital Ryan just that's like the flash thing like turn that pin on through the flash then I pen off

If it on again for another flash, so it's pretty simple the commands or just write this values of this pin

I think that was probably overly complicated. I wish Edison for sketchup

Give them it is a very close analogue of Java the idea is almost identical to processing it. Yeah

Oh yeah, I mean yes if you go to processing door gets like

References, and then just a list every command and everything you could do with it

Yeah, most like literally nine. Ten of what I showed you was already included and I just did a couple quick modifications

And I just want to reiterate that if you have been timid about coding or whatever reason this is that you can't break it this

Is the easiest way to start start a processing script and say we also want to do it?

I want to add a circle, okay circle at these coordinates and see if it works

That's how you learn break stuff little by little if you have to have it working and then you and you can mentally grasp okay?

What does that mean and you can pick it up? Let me it took me a week

I think that's a last question unless there's any one is really

Yeah, yeah, yeah, you know what um you are all free to go

But I'll hook up my let me just download the sketch it if you want to stay then

Upload it right now, and I'll show you the pope's they're awesome

This is what I want my I mean this one

I'm pursuing my future and I'm using both these open-source platforms to prot

You know propel me out there not a lot of musicians do coding so there's this interesting dynamic of I'm using

processing to present cool visuals that are you know I can mess with and

edit and do whatever I want to vote and then make my own electronic drum set with a

cheap little Led or Arduino controller for fifty bucks

Thank you