Survey says: MBTA not so bad
By adamg - 12/10/09 - 12:43 am
More than 100 T riders who kept daily trip diaries for the annual TransitWorks Transit Diary Study reported that, on the whole, they were satisfied with T service - except for noisy, uncomfortable trains:
TransitWorks believes as it did in the last Transit Diary Study that it is imperative for the MBTA to better address the misrepresentations of public satisfaction that are prevalent in media reports. Data shows that riders are, in fact, satisfied with their transit service. It is the charge of the MBTA to reinforce actual satisfaction levels to the riding public.

Comments
Wellllll...
If you ask a battered wife if she's "satisfied" with her husband, she'd say "yes" too.
Shortcomings
I think there's an important point hidden in Kaz's snark.
The survey is centered around riders' perceived satisfaction, and we've been conditioned to be satisfied with very little.
I participated in the previous two surveys before this year's. One of the things I learned is that on most days, the T gets me from one place to another without making me stand around a long time in one place, feel personally endangered, or subject me to intolerable filth. When that happened, I decided the T was doing an OK job, since I don't expect them to consistently rise beyond that level. I think the popularity of "neutral" in many categories suggests that many share my attitude -- it's a virtual shrug of the shoulders, as if to say "it's not great, but what else is new?"
The survey doesn't allow statistical representation of why people are unsatisfied with some things. The report highlights station announcements as having a higher dissatisfaction rating, but except for asking whether people heard the announcements, I don't think they can get at what people don't like: Too often? Too many ads? Not often enough? Erroneous? For example, if station announcements on the Red Line were audible but wrong (which happens a lot), I don't see a statistic that could have reflected it.
It's also reprehensible that the survey didn't consider a ride late until it was more than 30 minutes late. Five minutes late may not count, but 10 minutes should.
The survey also doesn't ask riders about what I think are some important, broader issues. I'm very concerned about the age of the system and the safety risk from the heap of deferred maintenance, especially considering the report issued last month. I also have no faith in the T's ability to manage a crisis that disrupts service. I have never seen timely replacement service or clear, correct information about what is happening and what riders should do. Both of these are several levels above the data collected in the survey, and they both contribute mightily to the T's poor reputation.
Finally, I find it remarkable that respondents saw fare evasion 7% of the time. That's maybe $200,000 a day in lost revenue? Seems like that cash could come in handy.
Yep
When you are running a schedule of "every 15 minutes" and you're allowed to be late by 30 minutes before putting yourself in the "Late" column...well, what keeps you from running every other train, wiping your hands clean, and patting yourself on the back?
Also, once I've got my normal commute route, I don't have to think about things like "well, why do I have to go all the way to Park Street just to get into Cambridge on the T??" that are the source of dissatisfaction when you start looking for how to get from here to there.
How many respondents were looking to get home at 2 AM after the bars closed and thought..."damn, if only there was a train!" and whipped out their handy-dandy notebook (nod to Blue's Clues)?
All of the different problems with the MBTA don't necessarily always relate to the average commute...because we've grown accustomed to the current water temperature on a daily basis. Sure, there'll be the occasionally "shut. down. everything!" moments which they can easily dismiss as "unusual" (except when they start occurring once a month because the equipment is at its failure age). Sure, there's more "ya can't get thair frum heeah" than upstate Maine. Sure, it takes MORE than an hour to get from Brighton to Logan (20 minutes driving). Sure, 1/30 days of the month the fare machines fail, but that's less than a 5% failure rate. Sure...the MBTA is great...except when it's not.
Great survey, let's do it again next year.
T survey
Is about 100 riders a statistically valid sample?
It could be
100 would be enough IF it were a representative sample of ridership. I really doubt any effort was made toward that end.
It could be validated by ridership patterns represented in the diaries alone ... issues such as lines ridden, times of rides, start and end neighborhoods, etc.
Selection Bias Writ Large
100 people who kept transit diaries? Doesn't sound like a random sample of ridership to me. It sounds like a self- or otherwise select group - and when you select a small group of people based on exclusive attributes (e.g. willingness to keep a diary), you get biased measures.
I was one of the ppl that did
I was one of the ppl that did this transit diary. I found out about it on this site and decided to sign up. I did ask if the T knew about this survey b/c honestly it was the best 2 weeks of the D line that I've ever had.
I was kind of p*ssed about it b/c normally I wait forever for a train which when it pulls up it's to packed ot get on or we get kicked off b/c the train is going out of service or the drivers are so incredibly rude that I just shake my head. The "norm" didn't happen for these 2 weeks.
I do think that we are so used to a service that is less than stellar that if we make it to our destinations w/ out the train blowing up we think we are doing well.
I guess I am cynical as I don't think the service is improving I just think it was a fluke.
I agree
I participated as well last year and it was probably the best two weeks or service I had. My commute involves a bus that is hardly ever on time, but for those two weeks it was quite good. so good, that I was annoyed I couldn't show that no, my bus does not run "every 10 minutes or less" in the morning no matter what the T insists on printing on the schedule.
I didn't participate this year because I don't think it really represents T ridership well.
Don't think it's representative...
51% of the respondents reported income of $80,000 or more. That's way above the city average, let alone the average for transit riders.
Income -> satisfaction correlation?
I wonder if there's any relationship between income and satisfaction with the T. I assume most people making over $80K are also salaried, and they might not be quite as directly impacted by a 15-minutes-late train.
Good point
I don't make anywhere near $80k, but I am salaried and don't have to worry about making up time when my train is late.
And given that 100 people is easily the approximate load of a
single Green Line streetcar or single rapid transit car during rush hour, that sample doesn't even come close to being a statistically significant percentage of the total daily MBTA ridership on any of the bus, transit, or rail lines, let alone the entire system.
What about the bus?
It sounds like this survey was geared to light rail and train riders and not much (if any focus) on bus service.
Yes bus
Not so - I was a participant and I do all of my workday commuting by bus.
Bus Service
But ... but ... that isn't the 8:10 running 35 minutes late, or the 8:25 running 20 minutes late ... it's the 8:40 running on time!
On-time
Note that although the MBTA has a 30 minute window for "on-time", the survey asked riders how much time they spend waiting for the vehicle as well as how many minutes late it was. So if someone was expecting a bus at 8:00am but it didn't show up until 8:10am, they would report that the bus was 10 minutes late. The results of the survey show this reporting as well. (The survey does not use the MBTA's 30 minute "on-time" window.)
The 30 minute "on-time" window is for
the customer on-time refund program. AFAIK, the internal "on-time" criteria is still a maximum ten minute delay.
A former Green Line inspector (long since retired and moved away) I knew years ago told me that when the Canal Street surface station was still in place, management used to have a good dodge to fudge the numbers. If a C train heading for North Station was approaching the ten-minute delay mark entering Government Center, the dispatcher was directed to re-route the train back to Cleveland Circle at GC. Besides having the train available "on-time" for its next scheduled trip out of Cleveland Circle, the trip counted as "on-time" to North Station, even though the train never served North Station itself.
usa lags behind as usual
THIS SHOWS HOW FAR BEHIND THE REAST OF THE WORLD THE USa IS
http://en.wikipedia.org/wiki/High-speed_rail