Tag Archives: Polls

Autodesk discussion group update – what do you think?

11 Replies

On 4 June 2010, Autodesk turned off NNTP access to its discussion groups as part of the process of updating its software to use a different engine (the new one is from Lithium – here are its own forums). I am preparing a large post about what I think of the new web interface, but for now let’s hear from you on that subject. Please vote in the poll on the right, and add your comments once you’ve had a chance to put the “state-of-the-art web experience Autodesk customers have come to expect” through its paces.

In related news, I have now closed the short-lived poll about the end of NNTP access to these groups. The results were:

Should Autodesk shut down NNTP access to its discussion groups?
Yes (8.8%, 5 Votes)
No (59.6%, 34 Votes)
Don’t care (31.6%, 18 Votes)
Total Voters: 57

This is a small sample and must have some self-selection bias, in that those who cared about this move were more likely to read my post on the subject and vote about it. I attempted to temper this by including a “Don’t care” option, but some bias is still bound to be there. There is also likely to be some bias in the opposite direction, because people are less inclined to bother voting to try to fight a decision that had clearly already been set in concrete and which was never going to change.

That said, it does seem remarkable that only 5 people could be found who supported Autodesk’s decision to drop NNTP access. According to my long-running What is your relationship to Autodesk? poll, There are at least 25 (claimed) Autodesk employees who are active enough on this blog to respond to its polls! Without wishing to compromise the private nature of my polls, I can reveal that the 5 Yes votes included Autodesk employees and at least one non-Autodesk person (that’s as specific as I will ever get). There did not appear to be any attempt to distort the voting from either camp. I mention this because the survey mentioned in my previous post was disrupted in this way.

Command line poll replaced

7 Replies

For the past couple of months, I have been running a poll about the command line. I ran it using wording copied directly from a Project Butterfly poll, to get some kind of comparison between the poll respondents on this blog and those on the Project Butterfly blog.

It’s fair to say that I don’t like the wording of the available options, which appear designed to influence the result rather than find out what people really think. The “I can’t work with…” option has negative connotations; if I pick this choice, it implies that my abilities fall short in some way and I lack flexibility. On the other hand, the “I think it’s time for a new way…” option has a positive feel about it. If I pick this choice, I’m a thinker, I’m progressive, I’m looking to the future. It’s no accident that marketing people love to plaster “NEW!” over their products.

Despite the push-poll options, the command line was the clear winner on both blogs. Here are the Project Butterfly results (unknown number of voters):

I can’t work without the command line (66%)
I think it’s time for a new way to draw without the command line (34%)

Here are my results (378 voters):

I can’t work without the command line (81.7%)
I think it’s time for a new way to draw without the command line (18.3%)

I expected to see a greater preference for the command line among readers of this blog (largely command-line-using AutoCAD users) than among readers of the Project Butterfly blog (largely command-line-less Project Butterfly users). My expectation has been met. Instead of about a 2:1 majority there, command-line people here have about a 4.5:1 majority.

Now let’s try a similar poll, hopefully without biased options, and see if that affects the result. I have replaced the above poll with this one:

Should CAD software have a command line?

Yes
No

There are several ways in which this question could have been asked (do you prefer, is it more efficient, is it better, etc.), but the above appears to be the least biased I can come up with. Please have a look at this and other polls over on the right and vote if you feel so moved.

Ribbon poll roundup

Leave a reply

Further to my last post, Here is a brief summary of this blog’s various poll results that relate in some way to Ribbon and CIP use. The most recent polls are at the top of the list. I have placed in bold those percentages that relate directly to the proportion of AutoCAD Ribbon use among the voters on this blog.

  • AutoCAD 2010 users’  Ribbon use: 44% (AutoCAD 2010 users’ CIP on: 36%)
  • Ribbon love: 28%
  • AutoCAD 2010 menu bar non-users: 23%
  • Inventor Ribbon use: 44% (Inventor 2010 users’ Ribbon use: 59%)
  • Revit Ribbon use: 42% (Revit 2010 users’ Ribbon use: 58%)
  • AutoCAD Ribbon use: 32% (AutoCAD 2009/2010 users’ Ribbon use: 38%)
  • CIP on: 27%
  • AutoCAD 2009 menu bar non-users: 21%
  • AutoCAD 2009 Ribbon one of 3 best new features: 11%
  • AutoCAD 2009 Ribbon turned on in some way: 29% (fully visible 13%)

The polls were run at different times over the past couple of years with different questions being asked in different ways about different releases, and responded to by very different numbers of voters. Don’t expect consistent or directly comparable results; this is not a scientific study. As with all polls here, there is a self-selection bias; those people who feel most strongly about a subject are more likely to find these polls and make the effort to vote in them.

The more recent polls generally have significantly greater sample size than the early ones. The smallest poll (AutoCAD 2009 best new features) has 37 voters, the largest poll (AutoCAD users generally using Ribbon) has 751. While the former certainly qualifies as Shaan’s “a few dozen”, the latter does only if you consider 62 to be “a few”. In which case, can I give you a thousand dollars and you give me a few hundred back?

Here are the poll details, which you can also see in the Polls Archive. If you think any of these questions or the available responses are in any way biased or leading , I’d be interested to hear your reasoning.

AutoCAD 2010 users, what are your Ribbon and CIP settings?
Start Date: 15 March 2010

  • Ribbon on, CIP on (24.7%, 65 Votes)
  • Ribbon on, CIP off (19.4%, 51 Votes)
  • Ribbon off, CIP on (11%, 29 Votes)
  • Ribbon off, CIP off (44.9%, 118 Votes)

    • Ribbon
    Start Date: 16 January 2010

  • Love (28.2%, 164 Votes)
  • Hate (71.8%, 417 Votes)

    • AutoCAD 2010 users: pull-down menus – is your menu bar turned on (MENUBAR=1)?
    Start Date: 14 September 2009

  • Yes, it’s on all the time (69.3%, 475 Votes)
  • Yes, it’s usually on but I sometimes turn it off (4.1%, 28 Votes)
  • Yes in verticals, no in AutoCAD (1.9%, 13 Votes)
  • Yes (other) (1.5%, 10 Votes)
  • No, it’s usually off but I sometimes turn it on (7%, 48 Votes)
  • No, I never use pull-downs (13.7%, 94 Votes)
  • No (other) (2.5%, 17 Votes)

    • Inventor users: are you generally using the Ribbon?
    Start Date: 11 September 2009

  • Yes (44.3%, 82 Votes)
  • No (using 2010) (30.8%, 57 Votes)
  • No (using an earlier release to avoid the Ribbon) (15.7%, 29 Votes)
  • No (using an earlier release for other reasons) (9.2%, 17 Votes)

    • Revit users: are you generally using the Ribbon?
    Start Date: 9 September 2009

  • Yes (41.6%, 153 Votes)
  • No (using 2010 in unsupported classic mode) (30.2%, 111 Votes)
  • No (using an earlier release to avoid the Ribbon) (20.4%, 75 Votes)
  • No (using an earlier release for other reasons) (7.9%, 29 Votes)

    • AutoCAD users: are you generally using the Ribbon?
    Start Date: 9 September 2009

  • Yes (32%, 240 Votes)
  • No (using 2009/10) (51.1%, 384 Votes)
  • No (using an earlier release to avoid the Ribbon) (11.7%, 88 Votes)
  • No (using an earlier release for other reasons) (5.2%, 39 Votes)

    • Do you enable CIP (Customer Involvement Program) in your Autodesk products in production?
    Start Date: 23 February 2009

  • Yes, always (17.9%, 74 Votes)
  • Yes, on some products/releases (8.9%, 37 Votes)
  • No, because of privacy concerns (30.4%, 126 Votes)
  • No, because of performance concers (19.3%, 80 Votes)
  • No, it is not available for me (3.4%, 14 Votes)
  • No, other (20%, 83 Votes)

    • AutoCAD 2009 users: pull-down menus – is your menu bar turned on (MENUBAR=1)?
    Start Date: 28 November 2008

  • Yes, it’s on all the time (68.3%, 136 Votes)
  • Yes, it’s usually on but I sometimes turn it off (6.5%, 13 Votes)
  • Yes in verticals, no in AutoCAD (2.5%, 5 Votes)
  • Yes (other) (2%, 4 Votes)
  • No, it’s usually off but I sometimes turn it on (2%, 4 Votes)
  • No, I use the menu under the big red A (6.5%, 13 Votes)
  • No, I never use pull-downs (9.5%, 19 Votes)
  • No (other) (2.5%, 5 Votes)

    • Choose the best things about AutoCAD 2009 (up to 3)
    Start Date: 11 July 2008

  • Ribbon (10.8%, 4 Votes)
  • Menu Browser (5.4%, 2 Votes)
  • Quick Access Toolbar (5.4%, 2 Votes)
  • Smaller floating toolbars (8.1%, 3 Votes)
  • Status bar changes (8.1%, 3 Votes)
  • Action Recorder (18.9%, 7 Votes)
  • Modeless layer interface (18.9%, 7 Votes)
  • Quick View Layouts/Drawings (8.1%, 3 Votes)
  • Quick Properties (13.5%, 5 Votes)
  • Spell checking in text editor (29.7%, 11 Votes)
  • Rollover tooltips for objects (13.5%, 5 Votes)
  • Enlarged tooltips for user interface (0%, 0 Votes)
  • ViewCube (21.6%, 8 Votes)
  • Steering Wheel (2.7%, 1 Votes)
  • ShowMotion (0%, 0 Votes)
  • Geographic Location (2.7%, 1 Votes)
  • DWFx (5.4%, 2 Votes)
  • Off-white model space background (0%, 0 Votes)
  • Drawing recovery changes (8.1%, 3 Votes)
  • Updated button images (2.7%, 1 Votes)
  • LISP bug fixes (13.5%, 5 Votes)
  • Scale List bug fixes (10.8%, 4 Votes)
  • Other bug fixes (10.8%, 4 Votes)
  • Improvements available only in vertical products (16.2%, 6 Votes)
  • Other improvements in base AutoCAD (8.1%, 3 Votes)

    • AutoCAD 2009 non-Ribbon users: why don’t you use it?
    Start Date: 20 June 2008

  • Uses up too much screen space (63.6%, 35 Votes)
  • Doesn’t make good use of my screen size/shape (45.5%, 25 Votes)
  • Using it minimised requires an extra click/hover (47.3%, 26 Votes)
  • Tab concept means extra clicks (65.5%, 36 Votes)
  • Dislike concept of hiding tools – want buttons to stay visible (60%, 33 Votes)
  • Tab switching is too slow (45.5%, 25 Votes)
  • Button click reaction is too slow (38.2%, 21 Votes)
  • Turning it off saves startup time (30.9%, 17 Votes)
  • Ribbon content doesn’t match my needs (43.6%, 24 Votes)
  • All the commands should be on it (27.3%, 15 Votes)
  • Express Tools are missing (32.7%, 18 Votes)
  • Other things I use frequently are missing (40%, 22 Votes)
  • Too hard to find things (50.9%, 28 Votes)
  • No advantage over existing methods (63.6%, 35 Votes)
  • Customising it is too difficult (43.6%, 24 Votes)
  • Don’t like the colour scheme (16.4%, 9 Votes)
  • Don’t like fuzzy text (ClearType) (25.5%, 14 Votes)
  • Using a vertical product that doesn’t make use of the Ribbon (23.6%, 13 Votes)
  • Want to avoid training expense/inconvenience (18.2%, 10 Votes)
  • Want to avoid initial productivity reduction (18.2%, 10 Votes)
  • Inconsistent with other programs we use (e.g. Office pre-2007) (12.7%, 7 Votes)
  • Opposition to Microsoft’s influence (23.6%, 13 Votes)
  • I’m a Luddite and resist change for the sake of it (7.3%, 4 Votes)

    • AutoCAD 2009 users: in what state do you usually have your Ribbon?
    Start Date: 28 May 2008

  • Horizontal and fully visible (10.4%, 8 Votes)
  • Horizontal and minimised to panel titles (5.2%, 4 Votes)
  • Horizontal and minimised to tabs (7.8%, 6 Votes)
  • Vertical, floating and fully visible (1.3%, 1 Votes)
  • Vertical, floating and auto-hiding (0%, 0 Votes)
  • Vertical, docked and fully visible (1.3%, 1 Votes)
  • Vertical, docked and auto-hiding (Anchor left or right) (2.6%, 2 Votes)
  • Turned off (71.4%, 55 Votes)

    • Autodesk’s CIP data – massively biased?

    10 Replies

    You may have seen Shaan Hurley and I having a discussion (ahem) over the validity of his statement:

    I really do use the ribbon now with AutoCAD 2010 along with most users as evidenced by the CIP data we receive daily from thousands of AutoCAD users who choose to send the great data.

    So, now you know. Most of you use the Ribbon now,  Shaan said so. Shaan, as he always has done in the past, declined my invitation to back up this assertion with more details. He has vast amounts of data collected from huge numbers of users. How could that possibly be wrong?

    Here’s how. CIP data is biased.

    How can millions of data points be biased? Actually, all samples are biased. Only the degree of bias varies. The polls on this blog are no exception. I do my best to keep the questions and options neutral; the only leading questions you’ll see here in serious polls are the ones I copy and paste from Autodesk blogs. But readers of this blog are one self-selecting small portion of Autodesk customers, and people who vote in my polls represent another self-selecting portion of that portion.

    The question is, how biased is Autodesk’s CIP data? Without access to Autodesk’s data (which it won’t provide) and resources for alternative data collection from its customers (ditto), the best I can do is use my own biased sample (that’s you lot out there) as a cross-check.

    Let’s examine it in light of Ribbon use among AutoCAD 2010 users. In an earlier comparison of my 2009 poll figures and Shaan’s CIP data, I wrote this:

    But Shaan’s CIP users are also a biased sample, comprising those AutoCAD users who have CIP turned on. Are users who go with the flow and have CIP on also more likely to go with the flow and leave the Ribbon on? Possibly, but I would have thought the CIP-on bias would be less significant than the blog-reader bias.

    I have recently run a poll to try to determine if that “possibly”, that hunch, has any basis. Let’s examine the results I got.

    AutoCAD 2010 users, what are your Ribbon and CIP settings?

    Ribbon on, CIP on (24.7%, 65 Votes)
    Ribbon on, CIP off (19.4%, 51 Votes)
    Ribbon off, CIP on (11%, 29 Votes)
    Ribbon off, CIP off (44.9%, 118 Votes)

    Total Voters: 263

    For the sake of argument, let’s make the assumption that my poll sample is unbiased. It’s not, and the degree of bias is unknown, but let’s see what it would mean if it was. Let’s see what kind of results Autodesk would see from its CIP sample:

    CIP-on voters (94):
    Ribbon on 69% (65)
    Ribbon off 31% (29)

    Shaan would see from this result that 69% of AutoCAD 2010 users have the Ribbon on, and would be tempted to say stuff like “use the ribbon now with AutoCAD 2010 along with most users”. Understandable. That’s just CIP users, but non-CIP users can’t be that different, surely? Or can they?

    CIP-off voters (169):
    Ribbon on 30% (51)
    Ribbon off 70% (118)

    Wow. That’s a huge discrepancy, and it implies that a sample selection based on CIP use introduces a massive bias. I’ve watched this poll grow over the weeks, half-expecting things to even out as the sample size increased. It didn’t. It has been pretty constant, with non-Ribbon non-CIP users outnumbering Ribbonite non-CIP users by a substantial margin.

    Let’s put the groups together, shall we?

    All voters (263)
    Ribbon on 44% (116)
    Ribbon off 56% (147)

    So, if the voters in my poll were observed by Autodesk via CIP they would appear to be 69% Ribbon users. In fact, only 44% of these voters are Ribbon users.

    How many AutoCAD 2010 users really have the Ribbon on? 69%? 30%? 44%? Some other number? I don’t know, and that’s not the point. The point is, Autodesk doesn’t know either. It can take some smart guesses, but just assuming CIP is accurate isn’t smart, it’s just a guess.

    Why does this matter? Because Autodesk makes decisions based on this stuff. Decisions that affect you and me and how we use our tools. Have a look at this statement from Autodesk’s Teresa Anania, Director of Industry Management (taken from her interview with Deelip Menezes about Inventor):

    …we had data that suggested that the new ribbon UI was well received and would be absolutely all that customers needed …. And now since we have the CIP data that shows us how our customers are using the software, we can analyze this before we permanently turn anything off.

    Comments like this (and others from other Adeskers) seem to indicate that there is an unspoken assumption that CIP users accurately represent a true cross-section of users in general.

    I know that Autodesk doesn’t rely solely on CIP; it uses a wide range of research tools to find out what users are up to and what they need. I regularly encourage you to participate in various Autodesk surveys, for example. But there are problems of accuracy inherent in all those methods. It would be natural, when faced with a set of apparently conflicting results from different sources, for Autodesk decision-makers to simply assume that the source with the biggest sample size is the most accurate. That could be a dangerous mistake, for both Autodesk and its customers.

    Note: my arithmetic was off in several places when I posted this, and I have edited the post to correct some of the figures. These corrections do not invalidate the arguments; the substantial bias is still evident.

    Competition poll now open

    Leave a reply

    In a shock move, Autodesk’s general design product for this year was named AutoCAD 2011. I thought AutoCAD Banana or Generic CADD 7 stood a chance, but it was not to be. Maybe next year?

    Over on the right is a poll to allow you to choose who of the 14 entrants wins the prize in the pin the name on the product competition to come up with an alternative name. I’ll leave the poll open for about a week. Entrants can vote for themselves, but only once. Please vote for the entry you like the best!

    AutoCAD 2011’s new Help system – what do you think?

    15 Replies

    With all this talk of clouds in the air, it is interesting to note that Autodesk has moved AutoCAD’s Help system to a browser-based format, with online access as the default. So, how has Autodesk done with this first dipping of its toes into the cloudy waters with its primary mainstream product? I’ve already had a couple of unsolicited comments on the subject, and I’d like to hear from you. How do you rate the following, compared with previous releases?

    • Performance (online)
    • Performance (offline)
    • Search results
    • Content completeness and accuracy
    • Ease of manual browsing
    • Efficiency of user interface
    • Concept of online Help
    • Anything else you want to mention

    Please comment to express your views and use the poll on the right to provide an overall rating of the new system.

    Polls, especially CIP and Ribbon settings

    7 Replies

    I encourage all my readers to participate in the variety of polls I have made available, over towards the right of this site. In particular, if you’re a user of base AutoCAD 2010, please have a go at the AutoCAD 2010 users, what are your Ribbon and CIP settings? poll. The results so far are very interesting, but the numbers are currently too small to be significant. My two longest-running polls are now approaching a thousand votes each, and it would be great to see several hundred responses to the Ribbon/CIP poll.

    While I’m on the subject of polls, I’ll repeat some comments I made a while ago. Back then, I noticed that more than one person had been voting multiple times. While this is technically possible for people who have access to the Internet via multiple IP addresses, it’s obviously not desirable. The idea is that you have one vote each. While you might be able to work around that restriction to give yourself a little extra influence on the result, doing so is less than honest.

    I accept that people who have access via home and work might accidentally vote twice on occasions, but if I perceive a continued pattern of deliberate abuse I will remove the offenders’ access rights to this site. As I respect everybody’s privacy I will not reveal any identities, drop any hints or make any announcements about this, I will just do it.

    Just to make the privacy issue completely clear, I will not, under any circumstances in public or private, reveal who has voted for what. To anybody. Similarly, I will not reveal to any party any identifying information behind any of the users of this site, with the exception of spammers.

    Fortunately, the influence of dodgy votes on poll results has so far been small and in most cases statistically insignificant. That is, it does not invalidate any conclusions that might be drawn from the overall poll results. The more valid votes there are, the less influence the multi-voters will have, so go to it and have your say. Once, please!

    Can you work without a command line?

    15 Replies

    On the Project Butterfly blog, a recent poll gave these choices:

    • I can’t work without the command line
    • I think it’s time for a new way to draw without the command line

    In a follow-up post, the observation was made that “We thought that only a few people would work without a command line, but the results were refreshing.” Apparently, only 66% of respondents selected the first of the available options.

    To this I respond, “Beware the trap of the biased sample”. The poll asked people who are largely users of a product that involves drawing without a command line if they can work without it. In response, an amazing 2/3 of them say “I can’t work without the command line”, i.e. they can’t possibly do what they are currently doing, every time they use the product on which the blog is based.

    How is that “refreshing”? 34% is an incredibly small number when the only alternative answer is self-contradictory. It should be very close to 100%, surely?

    Every poll has a biased sample, including my own polls here. The trick is in working out how strong the bias is and determining if it invalidates the results. In this case, readers of the Butterfly blog are largely users of a command-line-less product and therefore likely to have a strong bias against the command line. So that 66% number would be a bit bigger if addressed to a more general population, I reckon.

    I’ve added my own poll for my own biased sample (that’s you lot out there, largely users of a command line-based application) using exactly the same question format. I’m not entirely happy with the way the options are worded as it is not entirely neutral, but I’ll stick with it for the purpose of the comparison.

    While I might dispute the conclusions that might be drawn from the poll, I must say that I like the way the Project Butterfly team is doing this in the open. It’s much better than the traditional Autodesk practice of claiming that what they are doing is supported by polls among customers, then refusing all requests for the full details of those polls. As the devil is in the details, I automatically discount any such claims based on secret research, from Autodesk or anyone else. I encourage the Butterfly people to keep doing what they are doing, regardless of any nitpicking from me; it is very refreshing (there’s that word again) to see Autodesk being open and I want to encourage it.

    In addition to voting, I’d love to have you add your own comments either for or against use of the command line in CAD. It may be old and unfashionable, but does that make it inefficient? Have you tried turning it off in AutoCAD and running purely on Dynamic Input? Have you had experience with CAD or similar products without command lines? Let’s hear it.

    Ribbon acceptance in AutoCAD and Revit

    24 Replies

    AutoCAD Ribbon use (and non-use) may have been the hottest topic on this blog to date, but it’s a storm in a teacup compared with what has been going on between Revit users and Autodesk. More on that later, but for now I’d just like to pass on a statement made by Autodesk BIM Design Product Line Manager Anthony A. Hauck on the AUGI forums that:

    Recent data on other Autodesk applications having both the new and “classic” UI show about a 2 : 1 split in favor of the new UI.

    I would be interested to know the full details behind this assertion. Whenever I see a baldly-stated statistic like this, my first thought is “where did it come from?” Without full details of the data and how it was obtained, every statistic like this is suspect at best. It could just as easily be useless or misleading. I’m afraid I’ve become rather cynical whenever I see any kind of Autodesk statistic. When challenged in the past, Autodesk has consistently failed or refused to back up its marketing statistics (or even vague assertions that certain secret Autodesk-supporting statistics exist) by providing the comprehensive details required to make them useful. I’d love to be proven wrong in this case, but I won’t be holding my breath.

    Instead, I’ll just ask you and we’ll see how the numbers compare. Over on the right, there are two new polls on Ribbon use; one for Revit and one for AutoCAD. If requested, I’ll do similar polls for Inventor and 3ds Max. Please add your vote and feel free to comment.

    These messages are brought to you by AutoCAD

    7 Replies

    Over the past few releases, and particularly in AutoCAD 2009 and 2010, I have noticed an increase in the number of information notices (bubbles, warnings, task dialogs, Communication Center notices, etc.) being displayed. Shaan Hurley has pointed out that 2010 Update 1 introduces a balloon notification that periodically makes you aware of how much time remains before your subscription expires. Is this a good thing?

    There’s a poll on the right that asks a specific question about the default state of AutoCAD 2009 and 2010, but I’d also like to see some comments on this. What do you think of these messages? Are they useful? Do they get in the way? Do you take any notice of them? Are there too many? Do we need any others? Do you turn them off? Is it easy enough to control them?

    The 12-month cycle and shipping software with known bugs

    9 Replies

    In a recent blog post, Deelip Menezes appears to be shocked by the very idea that a particular CAD company (no, not Autodesk) would ship software that contains known bugs. I thought he was joking, because he’s surely aware that practically all software companies with highly complex products release software with known bugs. As Deelip points out, those companies with 12-month cycles are particularly prone to doing this. There is no possible way any company can release something as complex as a CAD application within a fixed 12-month cycle without it containing dozens* of known bugs (because there isn’t time to fix them after discovery) and dozens* of unknown ones (because of insufficient Beta testing time).

    Reading Deelip’s post and subsequent comments more carefully, it becomes clear that he doesn’t mean what a casual glance might lead you to believe he means. Deelip makes a specific distinction between “bugs” and “known issues”. He states that if a bug is discovered and the software is then adjusted such that it does not abort the software in a badly-behaved way, and this is then documented, then the bug ceases to be a bug and becomes a “known issue”.

    I disagree. Bugs can cause crashes or not; they can cause “nice” crashes or not; they can be known about prior to release or not; they can be documented internally or not; they can be documented publicly or not. As far as I’m concerned, if the software doesn’t act “as designed” or “as intended”, then that’s a bug. Here’s what Wikipedia has to say, and I concur:

    A software bug is the common term used to describe an error, flaw, mistake, failure, or fault in a computer program that prevents it from behaving as intended (e.g., producing an incorrect or unexpected result).

    That doesn’t mean that software that is “as designed” (free of bugs) is free of defects. Defects are things that make the software work in a way other than “as it should”. They can be bugs, design errors or omissions, performance problems, user interface logic failures, API holes, feature changes or removals with unintended undesirable consequences, and so on. Unfortunately, defining “as it should” isn’t a precise science. You can’t just compare the software to the documentation and say that the differences are defects. The documentation could be faulty or incomplete, or it could perfectly describe the deeply flawed way in which the software works.

    While I disagree with Deelip’s definition of bugs, I couldn’t agree more with a more important point he makes in his blog post. That point is of a fixed 12-month cycle being the root cause of a plethora of bugs/issues/whatever making it into shipping software, and this being an unacceptable situation. This is a view I expressed in Cadalyst before I started participating in Autodesk’s sadly defunct MyFeedback program, and it’s a view I hold even more strongly today.

    In conclusion, I would have to say that the fixed yearly release schedule is not good for AutoCAD. It is good for Autodesk, certainly in the short term, but that’s not at all the same thing as being good for AutoCAD or its users.

    I’m not alone in thinking this. The polls I’ve run on this subject, discussions with many individuals on-line and in person, and many comments here and elsewhere, indicate that a dislike of the 12-month cycle is the majority viewpoint. For example, when asked the question, “Do you think the 12-month release cycle is harming the quality of AutoCAD and its variants?”, 85% of poll respondents here answered “Definitely” or “Probably”. In another poll, 71% of respondents indicated a preference for AutoCAD release cycles of 24 months or greater.

    Somebody please tell me I’m wrong here. Somebody tell me that I’ve misread things, that customers really think the 12-month cycle is great, and that it’s not actually harmful for the product. Anyone?

    * Or hundreds. Or thousands.

    Evan Yares, ODA, Autodesk and click-through agreements

    Leave a reply

    I’ve always found it entertaining when the lawyers of CAD companies do their best to make their clients look like total jerks. The opening shots as presented by Evan Yares in his proposed ODA class-action lawsuit indicate that there is another rich source of recreational reading on its way. I’m sure it’s no fun for the lawyer-paying people involved, though.

    You would think that Autodesk would be rubbing its corporate hands together at the prospect of the ODA being distracted like this. Or maybe not, if the bunfight throws up more little gems like this:

    Autodesk had at least once gone to the ODA website, agreed to the click-through membership agreement, received their access password via email, downloaded each and every library on the ODA’s website, then denied they did it. (The ensuing conversation about this, between the ODA and Autodesk, was pretty interesting, to say the least.)

    If that’s true (and I would welcome evidence from either party) it certainly puts an interesting slant on what Autodesk thinks about the enforceability of click-through agreements.

    On a related subject, see the polls on the right. There has been one running for a while about whether you even read such “agreements”, and I’ve added two more. They ask if you feel morally and legally bound by the terms that lie under that “let me get on with the installation” button.

    AutoCAD 2010 – Will you miss the Menu Browser?

    6 Replies

    I’ve closed the poll that asked AutoCAD 2009 users about their MENUBAR setting. It’s very clear that pull-down menus are still very much in use in the Ribboned world of post-2008 AutoCAD. In AutoCAD 2009, an attempt was made to provide access to pull-down menus without sacrificing that strip of screen real estate. That attempt was called the Menu Browser, it was one of the thing you could find under the Big Red A, and it really didn’t work very well. In AutoCAD 2010, the Menu Browser has gone away. The A hasn’t gone away, just the ability to access pull-down menus through it.

    There are some who have expressed a deep dislike of the Big Red A, although it never offended me greatly. I just wished the features hidden under it worked better than they did in 2009. Personally, I generally prefer what’s under the A in 2010 than what’s there in 2009, but you may not. I know that when the 2009 user interface was being attacked, its most prominent defenders were those keyboard-heavy users who turned both the Ribbon and the menu bar off, giving themselves more screen space. On the infrequent occasions when a pull-down menu was required, those people were content to provide an extra click.

    When I found out about the Menu Browser’s death a few months ago, I expected there would be a severe adverse reaction from such people. Maybe there will be one when people hold get the shipping product and notice it’s gone. But after my poll showed only 7% of respondents used it instead of the menu bar, I’m now expecting that adverse reaction to be smaller than I originally thought.

    If you want to use AutoCAD 2010, want to work without a menu bar but still have access to menu items occasionally, what can you do? You can add a button to the Quick Access Toolbar (QAT), or any other toolbar, that toggles the menu bar on and off. Use the CUI command to add such a button.* The following macro will do the job:

    'menubar $M=$(-,1,$(getvar,menubar))

    There are a couple of downsides to this method. First, although this macro has been written in such a way that it should be transparent, it doesn’t currently work that way. When you push the button, AutoCAD will still cancel any command you’re in. Second, the screen resize forces a redraw, which could slow you down in very complex drawings. However, under most circumstances that redraw will still be quicker than waiting for a reaction from AutoCAD the first time you pick the Big Red A. By the way, that reaction time is better in 2010 than the very tardy 2009. As a result, even AutoCAD 2009 users might prefer to use the QAT-button method and forget the Menu Browser ever existed.

    * If there is enough interest, I will do a video tutorial explaining how to add such a button to the QAT.

    AutoCAD 2009 – Do you use the menu bar?

    22 Replies

    You may have noticed that I’ve added a poll to find out if the AutoCAD 2009 users among you are using the menu bar (i.e. MENUBAR = 1). I’m also interested in hearing your comments about your usage and the reasons behind it.

    If your menu bar turned on, why? Do you use it all the time or do you just need it for those less-frequently-used commands that you don’t have handy at your fingertips, on toolbars, palettes or the Ribbon? Do you need it because your own custom routines are on menus, or third-party commands? Does the vertical AutoCAD variant you’re using need it?

    If your menu bar is turned off, why? Do you never have any need for the stuff in there? Do you use the Menu Browser instead, sacrificing an occasional extra click for the sake of a permanent strip of screen space?

    How well cooked is the average major new AutoCAD feature these days?

    3 Replies

    I’ve now closed the poll that asks this question, and the results show a typical bell-curve shape with the peak clearly on “Half-baked”. There is a slight bias to the bottom end, but not a significant one.

    This result doesn’t surprise me, as I’ve seen and heard a lot of user comments to that effect, and I’ve made such comments myself.  I’m not saying that this poll is definitive proof of anything, but it sits pretty well with my perception of what AutoCAD users generally think.

    Now I’d like you to consider a related question. If we accept for the sake of argument that the average major new AutoCAD feature is half-baked, is that necessarily a bad thing? There are some valid arguments that can be made for pushing out features before they are complete. I’ll examine the pros and cons from my perspective later, but for now I’d like to hear from you.  What do you think?

    Autodesk discussion groups – signs of life?

    Leave a reply

    After an extraordinarily long period of total silence about the dreadful state of the appallingly-updated Autodesk discussion groups, it seems that the sleeping monster has raised an eyelid. Although it unfortunately indicates that Autodesk intends to try to patch up the new system rather than throwing it away, there is now a “sticky” post at the top of each forum containing the following text:

    Your continued patience is appreciated as we work to resolve the discussion group issues you have been reporting. We understand the impact these issues have on your productivity, and want to assure you we are continuing to troubleshoot and resolve. We’ve posted an update under “Help” to provide awareness and status of the issues we are working on. We’ll regularly update this as improvements are made.

    Never mind the glacial nature of the response, it’s good to see that an acknowledgment has finally been made of the problems. However, picking on the Help link reveals that there’s a long way to go yet before all the problems are even fully understood by the team responsible, let alone fixed. Only three “Known Issues” are listed, and four issues are allegedly resolved. At least one of those, shown as resolved on 7 October, is still very much broken right now. At least one of the FAQ items, “Why can’t I stay signed in?”, gives false information.

    Discussion group team, you will find a lot more than seven issues listed on this blog alone. To see them, just click on the Newsgroups link in the Tags section on the right. Alternatively, you could use the Search box at the top and enter something like “discussion groups”. A search that actually finds everything? There’s a novel idea.

    Rate Autodesk, vote once

    2 Replies

    I’ve added some new polls that ask you to rate Autodesk in five specific areas. I’ve seen some criticism of Autodesk in these and other areas, but that doesn’t mean the criticism is valid. I’d like to know what you think. Please be fair, and base your votes on your own experiences. If you have suggestions for similar polls, add a comment.

    I have closed several other polls, and will be discussing the results later.

    Poll abuse

    On the subject of polls, I have noticed that more than one person has been voting multiple times. While this is technically possible for people who have access to the Internet via multiple IP addresses, it’s obviously not desirable. Like the forthcoming US elections, the idea is that you have one vote each. While you might be able to work around that restriction to give yourself a little extra influence on the result, doing so is less than honest and is likely to get you in trouble.

    I accept that people who have access via home and work might accidentally vote twice on occasions, but if I perceive a continued pattern of deliberate abuse I will remove the offenders’ access rights to this site. As I respect everybody’s privacy I will not reveal any identities, drop any hints or make any announcements about this, I will just do it.

    Just to make the privacy issue completely clear, I will not, under any circumstances in public or private, reveal to anybody who has voted for what. Similarly, I will not reveal to any party any identifying information behind any of the users of this site.

    Fortunately, the influence of dodgy votes on poll results has so far been small and in most cases statistically insignificant. That is, it does not invalidate the conclusions that can be drawn from the overall poll results. The more valid votes there are, the less influence the multi-voters will have, so go to it and have your say. Once, please!

    The Autodesk discussion groups are awful

    3 Replies

    Yes, the Autodesk discussion groups are still awful. In other breaking news, the Pacific Ocean continues to be wet.

    I seldom visit them any more, but I just hopped on to the Autodesk discussion groups to see what progress had been made in fixing the many problems that have been pointed out here, on the groups themselves, in official problem reports, and elsewhere. Little or none, it seems.

    Search? There are still apparently only 188 uses of the word “autocad” in the tens of thousands of posts in the AutoCAD groups, ever. Editor? It not only still vacuums, when I just tried it out it vacuumed even harder than before, with delays of over a minute when switching between tabs and nasty screen formatting issues when the switch eventually occurred. Attachments that can’t be viewed? Check. Visible email addresses? Yup, still there. Everything I looked at was just as bad as it was last time I looked. Maybe something has been improved somewhere, but I gave up looking.

    I know there’s an Autodesk cultural tendency to pretend problems don’t exist for the sake of saving face, but that just doesn’t cut it here. (Actually, it doesn’t cut it anywhere, but that’s another story). What kind of face does this debacle present to the world? What does it make Autodesk look like?

    • A company that doesn’t understand the Internet.
    • A company that doesn’t know how to write software that works.
    • A company that fails to seek user feedback on changes until it is too late.
    • A company that can’t fix things that are broken.
    • A company that doesn’t care about its customers’ privacy.
    • A company that refuses to listen to customers who point out problems.

    Now I happen to know that this is not a fair and accurate representation of everyone and everything at Autodesk. Nothing like it. Nevertheless, that is the face that is being presented by this utter disaster of an “upgrade” and the failure to fix or even acknowledge the problems introduced by it. The people at Autodesk who really do care about the customer (yes, there are many such people) must be sickened when this sort of thing happens, particularly when it happens in such a public way. It reflects badly on everybody in the company, even the majority who are well-meaning and innocent of customer-harming activities.

    It is now over a month since the old (and perfectly functional) discussion groups were killed. It does not appear to be possible to make the new ones work adequately. Autodesk, please bite the bullet and end this failed experiment now.

    What is a reasonable amount of time to wait for license codes?

    2 Replies

    Software companies use a variety of differerent methods in their attempts to prevent piracy and restrict use of their software to legitimate paying customers. Yes, these attempts are generally futile. Yes, they can end up inconveniencing legitimate users and providing pirate users with advantages over paying customers. Yes, they add to development costs and detract from the main development aims. Despite all that, I still support the right of software companies to do this. Lots of companies spend money doing futile, counter-productive things; it’s their money, their software, their customer base, their choice.

    That doesn’t mean we customers have to like it, and many of us don’t. Some of us happily accept it as part of the price of using our tools, some of us tolerate it with varying degrees of grace, and some of us fume about it but do it anyway because we have no choice. Beyond that point, there are those who won’t put up with it at all, and who find various ways around it.

    Where a given user fits within that spectrum of views depends partly on that person’s personality, but also on the amount of inconvenience that the software throws up. I’ve started a new poll because I’m interested to discover what level of inconvenience people are prepared to put up with. What is a reasonable level of tolerance?

    The poll question refers to a scenario where you have the need to use a piece of software, and before you can do so, you need to obtain codes. The question is not specific to AutoCAD or Autodesk, it applies to any software that needs magic numbers before it will work. Software often allows grace periods before a code is needed, but there are also circumstances where such grace does not apply, so for the sake of this poll please assume that you need the codes before you can get on with your job. How long would you be content to wait for the codes and still remain a satisfied customer?

    My autodesk.com site survey experience

    3 Replies

    I just tried out the new discussion groups to see if anything has been fixed. After entering my password (yet again), instead of placing me back in the discussion groups with my 100-topics-per-page settings, I was transported to the main Autodesk page and given the chance to provide feedback. I was informed that a new browser window would be opened, and then… nothing. I waited a while, but still nothing. Or so it seemed. Actually, the new browser window appeared behind my existing browser window, so I found it eventually. I clicked on it, it opened another, bigger window and the survey started. Here are the questions and my responses:

    Which of the following best describes your primary purpose for today’s visit?
    . Other
    To see if the discussion groups are still broken

    How often have you visited Autodesk.com in the past 6 months?
    . 6 times or more

    A question about my industry group that didn’t want to copy and paste…
    . Other
    Question is not relevant

    Do you currently own an Autodesk product?
    . Yes

    Are you planning to make a purchase decision related to an Autodesk product?
    (I don’t know what choice to make here, none of them really fit. I’m on Subscription but that doesn’t mean I’m not involved in purchasing decisions; I am. I don’t know when the next purchasing decision will be, though. I picked:)
    . No.

    Which of the following titles best describes your role in your company?
    . IT Manager

    From which region are you accessing this site?
    (Can’t you tell?)
    . Australia / New Zealand / South Pacific

    How would you rate your overall experience with Autodesk.com today?
    . Very bad
    (Actually, I don’t really know because because I haven’t yet got to the discussion groups I asked for, so I’m taking a wild guess based on recent experiences. I later checked the discussion groups and found that this was an accurate guess.)

    Based on your best online experience, how would you rate www.Autodesk.com as a site that…

    (Now, notice that is’s asking about my best online experience. I assume that would be best ever? Going back years, right? Before the recent update, then? OK, I’ll answer fairly based on that assumption.)

    …is a reliable source of information that you trust?
    9 Very Good

    …leaves you feeling that your time was well spent?
    8 Very Good

    …helps you make well-informed decisions?
    9 Very Good

    …is easy for you to navigate?
    5 Fair

    …allows you to move rapidly to the information you need?
    6 Good

    …enables you to find what you’re looking for?
    7 Good

    …encourages you to return?
    7 Good

    …meets or exceeds your expectations?
    6 Good

    …you would refer to others?
    7 Good

    …has content that is relevant to the purpose of your visit?
    6 Good

    …gives you the amount of detail you need?
    6 Good

    …covers the range of information you need?
    7 Good

    …enables you to identify and contact the right people?
    0 Very bad

    …provides a positive interactive experience?
    8 Very Good

    …enables you to help yourself?
    7 Very Good

    That’s the end of that section, the progress bar is half-way though, so I go to the next section, which I assume is going to ask the same questions based on my worst experience. Oops, no it’s not! The survey is over! Thanks for playing.

    Now you know. So, if in a few weeks somebody from Autodesk refers to “survey results” that supposedly show how well the recent update went down with users, point them at this post. I gave high marks for some of my responses, but I wasn’t being asked about my experiences after the recent update. I was being asked about my best experiences, which is altogether different.

    This sort of thing is why I never take survey results from anyone at face value. I always insist on seeing the full details, otherwise I will give such results no credit at all. No details, no point.