Slot Machines Use Which Reinforcement Schedule

  1. Slot Machine Reinforcement Schedule
  2. Slot Machines Use Which Reinforcement Schedules

Understanding Cell Phone Addiction

I wake in the middle of the night and instinctively reach for my phone. I innocently tell myself that I just need to check the time. It’s still dark out and I will surely go back to sleep, but as soon as the iPhone is in my hand, muscle-memory takes over. Before I know it, I’ve checked my email, browsed through Instagram, scrolled through my Facebook feed, and gone back to Instagram.

Psychology PSYCH 5, Introductory Psychology, 5th Edition (New, Engaging Titles from 4LTR Press) Slot machines tend to keep gamblers playing by using a schedule of reinforcement. Fixed-interval b. Variable-interval c. A variable-ratio reinforcement schedule uses a predetermined ratio while delivering the reinforcement randomly. Going back to the slot machine, let’s say that you once again are casino management and want the slot machine to pay out 20 percent of the time, or every fifth time on average.

I check my phone first thing in the morning and right before I go to bed at night. I feel anxious if my iPhone’s battery is under 10%. I not only tap away on my phone while in line at the coffee shop, but I may continue tapping away as the barista takes my order. I check my phone during lulls in meetings, even in the middle of my favorite shows. It’s embarrassing to admit all of this, but I have a feeling that I’m not alone.

The percentage of smartphone users who would actually be classified as addicted is estimated between 10-12%, according to the director of the Center for Internet and Technology Addiction, Dr. David Greenfield. However, in a survey of cell phone users, Dr. Greenfield found that around 90% of Americans fall in the category of overusing, misusing or abusing their devices. A recent study also found that 50% of teens feel that they are addicted to their devices.

Cell phone addiction may not be an official psychological diagnosis just yet (as of the DSM-5), however it functions very similarly to gambling addiction.

Technology addiction expert, Dr. David Greenfield, refers to smartphones as “the world’s smallest slot machine.” He explains that smartphones, just like slot machines, operate on a variable reinforcement schedule. “Every once in a while you get a reward… a piece of information, a text, an email, an update… something comes through that you find salient or pleasurable, but you don’t know when you’re going to get it, what it’s going to be and how good it’s going to be.” This is exactly the same reinforcement schedule as a slot machine. What’s highly addictive about these things is the idea and the neurobiological expectation they set up that a reward is coming, but you don’t know when you’re going to get it.

Each of these little rewards, such as texts, likes, social media updates, trigger a dopamine release. Dopamine controls the pleasure centers in our brain. When this chemical is released, it feels good and makes us want more of whatever is boosting our dopamine levels. It’s the reason why we seek out more food and more sex. It’s also the reason why responding to one quick text message so often turns into a fifteen-minute time-suck of scrolling through internet memes. It causes a dopamine loop.

Dr. Susan Weinschenk explains this process clearly:

Slot Machine Reinforcement Schedule

Machines

“With the internet, twitter, and texting you now have almost instant gratification of your desire to seek. Want to talk to someone right away? Send a text and they respond in a few seconds. Want to look up some information? Just type your request into google… It’s easy to get in a dopamine induced loop. Dopamine starts you seeking, then you get rewarded for the seeking which makes you seek more. It becomes harder and harder to stop looking at email, stop texting, or stop checking your cell phone to see if you have a message or a new text.”

No wonder, so many of us are mindlessly overusing our devices.

While all of us are vulnerable to our smartphones’ dopamine loops and many of us are compulsively turning to our devices, most of us likely wouldn’t meet the criteria for being considered an actual addict.

Dr. Greenfield emphasizes that addiction is a combination of two things. First of all, addiction involves an abuse or dependency on a substance or behavior (in this case technology use) that is “beyond your control and outside the realm of reasonable use.” Secondly, “and most importantly,” Dr. Greenfield says it must be “impacting your life in some negative way, whether it be your home life, work, school, economics or social relationships.”

Furthermore, these other ingredients are necessary in order meet the criteria for addiction:

  • Increased Tolerance: Needing more time on your phone, updated technology or new apps to get your fix.
  • Withdrawal: Feeling ill at ease or anxious when you are away from your phone.
  • Mood Altering: Using technology to alter your mood or change your state of mind. For example, sending out a bunch of texts when you feel a bit down or turning to an iPhone game when you feel anxious.

Whether you meet the criteria for a full-blown phone addiction or simply want to reduce your emotional dependency on technology, there are lots of helpful strategies for breaking this bad habit.

Outsmart your smartphone by using technology to limit your technology use. Want to use your phone less? There’s an app for that. In fact, there are LOTS of apps for that. The BreakFree app, for instance monitors your phone usage, tallying up the number of times your unlock the screen, how many minutes hours you spend on your phone, which apps you use the most. The app then gives you a daily addiction score. If your addiction score alone isn’t motivation enough to make you think twice before using your phone, the app also allows you to set up notifications to alert you when you’ve been on your phone for an extended period of time or opened an app too many times.

Get your phone out of the bedroom. There are lots of reasons why you should not sleep with your phone. For starters, using your phone within an hour of bedtime leads to poorer sleep quality and more insomnia. If you’re like me and you check your phone every time you wake up in the night, your sleep is even more negatively impacted. Furthermore, when you wake up and check your phone before getting out of bed, you are reinforcing the habit for the rest of the day. Buy a cheap alarm clock and stop sleeping with your phone by your side.

Put yourself on a digital diet. The same way reducing your waistline involves breaking unhealthy habits and eating more mindfully, reducing your screen time requires similar self-control. When you want to lose weight, you have to stop eating the junk food. When you want to cut back on smartphone use, you have to stop using the junk apps. Delete those deliciously addictive games. Cut back on social networks the way a nutritionist might suggest you cut back on carbs. Quitting technology cold turkey isn’t a realistic option for most people, so this requires some real will-power. Temporarily (if not permanently) deleting your most frequently used apps can be a huge help.

Slot machine reinforcement schedule

Set up a digital schedule. Assign certain chunks of time throughout the day to go phone free. Experiment with leaving your phone at home when you go to dinner with your friends. Turn your phone off for a couple hours every day at the office so you can work without distraction. Leave your phone in the other room in the evenings in order to spend more quality time with your partner or children.

Get drastic with a digital detox. If you are open to trying something more extreme, Daniel Sieberg, author of The Digital Diet: The 4-Step Plan to Break Your Tech Addiction and Regain Balance in Your Life, suggests doing a full “digital detox,” where you spend an entire weekend with ZERO access to technology. Notify your loved ones in advance, power your devices off and stick them in a box or a bottom drawer, and ask a trusted friend to temporarily change your passwords to reduce temptation.After the detox, Sieberg suggests reintroducing technology slowly. He swears that a digital diet does wonders for reconnecting with the real world and improving relationships.

Slot Machines Use Which Reinforcement Schedules

Decide on a few steps you can take this week and get started.

Related Articles

Tags: addiction, habits, self development, self-understanding, technology
By Jeff Hwang
The pyschological principle behind hit frequency is a concept called variable-ratio reinforcement, which is generally defined as delivering reinforcement after a target behavior is exhibited a random number of times.
Let's take a slot machine, for example. A gambler sits down at a slot machine and bets $1 a pull. Now as you would expect, most of the time, the gambler will bet $1 and lose, which of course is great for the casino. But if all the gambler does is bet $1 and lose every time, eventually he will quit (and/or go broke) and never want to play again. And so every few spins, the slot machine will reward the gambler with a payoff: $1 here, $1 there; $5 here, $1 there.
And then every once in a long while, the machine will reward the gambler with a big payoff in the form of a jackpot.
Now none of this quite adds up, which is how the house wins in the long run. But the promise of the big payoff, along with the intermittent rewards, is generally enough for the casino to reinforce the target behavior, which is to have the gambler keep betting $1 a pull.
That brings us to our next topic, which is the reinforcement schedule.
Reinforcement Schedules: Variable vs. Fixed
There are two basic types of reinforcement schedules: variable-ratio reinforcement schedules, and fixed-ratio reinforcement schedules.
Let's start with the latter, which is the most basic. A fixed-ratio reinforcement schedule is a schedule in which reinforcement is delivered at fixed intervals. Let's say, for example, that you are the casino and you want the slot machine to pay out 20% of the time, or every fifth spin. That is, the gambler will lose $1 four times in a row and get a pyout on the fifth every time.
The reinforcement schedule would look something like this:
Slot Machine: Fixed-Ratio Reinforcement Shedule
Adjusted for payouts, the schedule might look more like:
Slot Machine: Fixed-Ratio Reinforcment Schedule with Payouts
In this scenario, for every 25 spins, the gambler would win $18 on the five winning spins and lose $20 on the rest, for a net loss of $2. For the house, this represents a payout rate of 92% (RTP) and thus a house edge of 8%, which isn't too far from the real thing, depending on what casino you are in.
Now all of this sounds great, but there is a major problem: Nobody would ever play a game with a payout (reinforcement) schedule like this one!
Ok, so maybe 'nobody' and 'ever' might be a little strong, but the point remains: It wouldn't take long for the gambler to figure out that this slot machine pays out every fifth spin, and only every fifth spin. And as a result, the gambler would eventually quit playing on the spins they know they are going to lose (assuming the payout amounts are still random, meaning that the location of the $10 payout on the schedule is either random or unknown, for example).
Using a variable ratio is the fix for this problem.
Variable-Ratio Reinforcement Schedule
A variable-ratio reinforcment schedule uses a predetermined ratio while delivering the reinforcement randomly. Going back to the slot machine, let's say that you once again are the casino and want the slot machine to pay out 20% of the time, or every fifth time on average.
Now your reinforcement schedule may look something like:
Slot Machine: Variable-Ratio Reinforcement Schedule
And adjusted for payouts:
​Slot Machine: Variable-Ratio Reinforcement Schedule with Payouts
In aggregate, the expectation is the same: Over 25 spins, the gambler will still net a $2 loss, again giving the casino a 92% payout rate and an 8% house advantage. But in reality, this scenario is far, far more likely to achive the desired result, which is to have the gambler keep playing. Because in contrast to the fixed-ratio reinforcement schedule, a variable-ratio reinforcement schedule with a 20% reinforcement ratio allows for clusters of payouts (e.g. back-to-back wins), as opposed to having spins (or blocks of spins) where the gambler can say for certain that he would lose, and quit playing as a result.
This is because the variable ratio does not specify when the payouts occur, only how often they occur on average.
That said, variable-ratio reinforcement is a concept with endless practical application. As some of you may have noticed, the above discussion came directly from the opening of my book Advanced Pot-Limit Omaha Volume II: LAG Play; in that book, the discussion was used to set the stage for how we think about adjusting c-bet (continuation bet) frequencies based on our opposition, though the concept applies to virtually any action from 3-betting pre-flop to floating the flop.
But with regard to game design, the concept of variable-ratio reinforcement applies most directly to our two basic forms of hit frequency:
  1. Payoff frequency, the traditional measure of hit frequency, and
  2. Betting frequency, the form of hit frequency which has largely been completely overlooked.

Jeff Hwang is President and CEO of High Variance Games LLC. Jeff is also the best-selling author of Pot-Limit Omaha Poker: The Big Play Strategy and the three-volume Advanced Pot-Limit Omaha series.

Comments are closed.