Are Your Subscribers Getting Your Newsletters?
Posted by Ken Cheung on Monday, June 12, 2006 in Tools : : 8 commentsI've been gathering delivery data on the four email broadcasting services I reviewed previously (FeedBurner, Zookoda, Squeet, and FeedBlitz). In my first test, I setup Zookoda and FeedBurner with my EDA Geek test mailing list (about 30 posts a week). I setup Squeet with EDA Blog, which has about five posts a week. Lastly, I setup FeedBlitz with this site, iZachy (about five posts a week during the test period). If I had to do it again, I would have set up all the services with the same site, but I setup the newsletter via FeedBurner. With the FeedBurner interface, you have to disable FeedBlitz and Squeet if you want to use the FeedBurner email service. In hindsight, I should have setup the newsletter directly from the FeedBlitz and Squeet sites.
With each email service I tested, I added my Outlook, Gmail, Yahoo, and Hotmail accounts to the mailing list. When you read the rest of this article, keep in mind that my tests are far from being scientific. I could and should have done a better job in keeping the factors influencing the outcome consistent with each service. Nevertheless, I think the results are interesting.

As you can see from the above chart, 94% of the newsletters arrived in my inbox from FeedBlitz, but only 60% from Zookoda. I was very surprised by the 60% figure. The results could have been better or even worst depending on the ISP you use for your Outlook emails. The first 21 newsletters to my Outlook account from Zookoda were stuck in the spam filter on the server. They never made it to the inbox on my computer. I had to log into the email server to retrieve them. This is not something most subscribers will do to get their free newsletters. After I switched ISP (for unrelated reasons), I got the next ten newsletters in my Outlook inbox without any problems. It appears some ISPs (well at least one ISP) have filters in place that can block Zookoda newsletters from your inbox.
Why Zookoda Gets Blocked
I have three theories on why Zookoda emails are more likely to be blocked than the other three services I tested. First, the "from" field does not match the mail server info in the email header. The "from" field in my Zookoda newsletters is whatever@whatever.com. However, the email header indicates the newsletters are actually being sent from quivamail.com, the commercial email service owned by Zookoda's parent company. Isn't this a common technique of spammers — sending emails with one domain listed in the "from" field when the emails are actually being sent from a completely different domain?
The "from" fields for the other email services are: DoNotReply@squeet.com, feedblitz@mail.feedblitz.com, and bounce-9999@emailenfuego.net on behalf of whatever@whatever.com. The last one is for FeedBurner, which is using emailenfuego.net to send out newsletters.
My second theory involves the honor system that is used when importing "opt-in" email lists to Zookoda. Having run the email marketing program at a major corporation, I can tell you that the honor system does not usually work. Marketing managers always tell me their email lists are opt-in's. A lot of these lists were not opt-in's and they generated a lot of opt-outs, bounces, and "I love you" phone calls from the Spam Fan Club.
The other three email services I reviewed do not rely on just the honor system: Squeet must approve your list before they allow you to import your list to their service, FeedBurner does not let you import lists directly (their team does the import), and FeedBlitz sends out notification emails to addresses on your import list. Most publishers who use Zookoda are honest, but the honor system does make it easier for spammers. The more spam generated via Zookoda (Quivamail), the more likely Zookoda will get flagged.
My third theory has to do with the subscription process. Both FeedBurner and FeedBlitz ask a question to verify you are human before they send verification emails to subscribers. On the other hand, Zookoda does not have an image verification step to screen out bots. As a subscriber, I hate the image verification step. However, the extra step makes sense if you don't want your service flagged by email servers. Consider what would happen if a bot submits a bogus email address several thousand times. Zookoda would send out verification emails thousands of time to xyz company and they would all bounce. Don't you think the email admin at XYZ company would notice all the bounces from Zookoda and start flagging emails from Zookoda? (Note: Squeet does not have an image verification step, but subscribers have to fill out an addition form to subscribe.)
Yahoo and Hotmail are Playing Games
In my second test, I switched the "from" field in Zookoda from something@yahoo to something@mydomain. I used my Yahoo account to create an account with Zookoda and didn't realize it would be used as the default "from" address. After the switch, more emails arrived in Hotmail (increased from 35% to 68%). It appears Hotmail was flagging Yahoo addresses. On the other hand, fewer emails arrived in Yahoo (dropped to 68% from 91%). Yahoo was more likely to deliver emails from other Yahoo email users. That explains why I get a lot of spam in my Yahoo account from other Yahoo addresses.

Gmail Lets in Everything
It appears Google lets just about everything in. The delivered rate was anywhere from 92% to 100%. It doesn't matter which service you use or what you have in your "from" address, Google will let it in. I found this a bit odd because I get very little spam in my Gmail account. If Google lets everything in, shouldn't my Gmail account be flooded with spam? I'm not sure if Google has a great spam filter or if it's because I have not had my Gmail account as long as my Yahoo and Hotmail accounts.
What Does All this Mean?
If most of your subscribers are using Gmail, it doesn't matter which service you use. They will get your newsletters. If reliability is critical (ie - paid subscription), FeedBlitz offers the highest delivered rate. If you are using Zookoda to send emails to Yahoo or Hotmail accounts, you can increase the deliverables by separating your list to separate Yahoo and Hotmail address lists and setting the "from" field to match the list. If your subscribers are using a desktop email client like Outlook and you love all the features of Zookoda, consider creating a second list with another service. If people complain that they are not receiving your newsletter, remove them from Zookoda and add them to the second list. You can also be proactive by contacting subscribers or posting a note on your site.
Below are the delivered stats for the four email broadcasting services I tested.
FeedBurner
| percentage | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 79% | 92% | 92% | 88% | 87% |
| spam filter | 7% | 0% | 0% | 4% | 3% |
| missing | 14% | 8% | 8% | 8% | 10% |
| Total | 100% | 100% | 100% | 100% | 100% |
| raw count | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 22 | 22 | 22 | 21 | 87 |
| spam filter | 2 | 0 | 0 | 1 | 3 |
| missing | 4 | 2 | 2 | 2 | 10 |
| Total | 28 | 24 | 24 | 24 | 100 |
Squeet
| percentage | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 78% | 94% | 94% | 89% | 89% |
| spam filter | 17% | 0% | 0% | 0% | 4% |
| missing | 6% | 6% | 6% | 11% | 7% |
| Total | 100% | 100% | 100% | 100% | 100% |
| raw count | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 14 | 17 | 17 | 16 | 64 |
| spam filter | 3 | 0 | 0 | 0 | 3 |
| missing | 1 | 1 | 1 | 2 | 5 |
| Total | 18 | 18 | 18 | 18 | 72 |
FeedBlitz
| percentage | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 95% | 93% | 93% | 93% | 94% |
| spam filter | 0% | 0% | 0% | 0% | 0% |
| missing | 5% | 7% | 7% | 7% | 6% |
| Total | 100% | 100% | 100% | 100% | 100% |
| raw count | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 19 | 13 | 14 | 14 | 60 |
| spam filter | 0 | 0 | 0 | 0 | 0 |
| missing | 1 | 1 | 1 | 1 | 4 |
| Total | 20 | 14 | 15 | 15 | 64 |
Zookoda (from = something@yahoo)
| percentage | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 32% | 100% | 91% | 35% | 60% |
| spam filter | 68% | 0% | 0% | 10% | 22% |
| missing | 0% | 0% | 9% | 55% | 18% |
| Total | 100% | 100% | 100% | 100% | 100% |
| raw count | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 10 | 23 | 21 | 11 | 65 |
| spam filter | 21 | 0 | 0 | 3 | 24 |
| missing | 0 | 0 | 2 | 17 | 19 |
| Total | 31 | 23 | 23 | 31 | 108 |
Zookoda (from = something@mydomain)
| percentage | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 74% | 100% | 68% | 68% | 77% |
| spam filter | 0% | 0% | 0% | 12% | 3% |
| missing | 26% | 0% | 32% | 20% | 20% |
| Total | 100% | 100% | 100% | 100% | 100% |
| raw count | Outlook | Gmail | Yahoo | Hotmail | Total |
| inbox | 20 | 25 | 17 | 17 | 79 |
| spam filter | 0 | 0 | 0 | 3 | 3 |
| missing | 7 | 0 | 8 | 5 | 20 |
| Total | 27 | 25 | 25 | 25 | 102 |
Interesting and very helpful observations.
excellent analysis. at the moment I use Feedburner, and am quite happy with it. I guess i'll give feedblitz a try based on your figures….
That's why RSS is so cool: If you trust a Website you can subscribe to their feed and you will never get spam. The publisher benefits, because you really get ALL "mails" to your inbox.
But since not everyone does know what RSS is, not talking about people who actually can receive RSS it will not be a replacement for newsletters in the near future I guess :/
[…] But I was quite surpised when I came upon this research and write up - Are Your Subscribers Getting Your Newsletters? 94% of the newsletters arrived in my inbox from FeedBlitz, but only 60% from Zookoda. […]
[…] In an earlier post, I reported on the reliability of various email broadcast services. I noted that Zookoda seems to be least reliable of the email services I tested. Until this week, I stuck with Zookoda because of the many free features that they offered. However, as some of you have already noticed, I finally gave in and switched to Feedburner. Even though FeedBlitz was more reliable in my tests, I went with FeedBurner because of three reasons: (1) the image verification step was handled via a pop-up, which didn't take my readers away from my site, (2) less branding, and (3) option to select a two-hour window to send out emails. I hate pop-ups and I know some pop-up blockers may block the image verification step, but I feel this option is better having readers taken off my site. […]
[…] Notes: (1) Price based on number of subscribers on the list. (2) Price based on the number of e-mails sent per month. (3) Price obtained by phone. (4) An additional premium list service fee is assessed for lists over 25K. (5) Charges an initial application fee. One more thing to keep in mind: deliverability. Any result-oriented person realizes that all above steps are of no use if the subscriber does not get your message. E-mail services can’t provide 100% delivery. So, you should think what service to choose not only on the basis of their pricing tag: […]
[…] deal is that I really want to like FeedBlitz. Their service seems solid and this review I read ranks their email delivery rates at the top. But, their interface is horrible. Unlike most of the […]
[…] el Blog izachy se publicó un análisis a mediados del año pasado refiriéndose a la capacidad de llegada de […]