Blog

In a future blog post I will analyze these questions as well as provide some conversation logs, but first we want to make the raw data available. As per our commitment to users, all personally identifiable information is redacted (****), and the rest is made available to the research community for R&amp;D purposes without the ability to identify or contact any user. Questions are provided as originally written, unless transcribed from a voice memo. This is a complete list of questions over the past few months from identified users (as opposed to system testers from partner organizations, the topic of a future post), only those from the small-scale retail sector. If you have any comments or insights we’d love to hear about them at mype.asesor.ia.sac@gmail.com[these are user-initiated questions. So it excludes all user questions in response to system-generated messages and tips. It excludes all follow-up questions on the same or similar topic within the conversation that the initial question started] USER QUESTIONSQué está pasando con el movimiento económico? ya que es mi punto es el negocio has bajado muchoRobo ormiga&nbsp;Me gustaría abordar el tema de la fachada o frontis de mi local me gusta me gustaría que sea más profesional y que llame más la atención para las ventasBuenos días mi principal problema es el maltrato al cliente yo estoy en todas las áreas de la bodega recepción de pedidos atención al cliente y atención de proveedores **** la bodega atiende los 7 días de la semana 15 horas diarias lo cual me desarrollado estrés **** lo cual me lleva a tratar mal al cliente en muchas oportunidades durante el día graciasComo calificar a un asistente para la bodegaTengo más gastos que ingresos. hace poco me hackearon mis cuentas bancarias haciendo que pierda cantidades fuerte de dinero por lo cual estado trabajando con tarjetas de crédito para comprar mercadería y las ventas estado muy bajo por mi zona afectando mi economía e incluso ya agote los préstamos personales de amistades y familiaLo que quiero saber es como administrar mis ventas. La verdad que yo vendo y apunto en un cuaderno y con el dinero compro lo que necesito de mercadería, pero a veces me falta.&nbsp;Cómo podría vender más?En el punto de Mi Local Ps Tengo Mucha competenciaCómo puedo acomodar mejor mi Bodega, mi local es amplio pero al FondoEs Bueno vender pan en la BodegaCómo atraer mas clientes a mi BodegaLa **** crédito me está vendiendo muy caroClaro, qué tal sabes el problema qie tengo es que tengo muchas deudas y quiero aumentar mis ventas por catalgo y no se como enpesarComo puedo mejorar mis ventas&nbsp;Quiero controlar mis inventarios y mi control de crédito a mis clientes y proveedoresQuiero saber como puedo hacer marketing para que se vea más vistoso mi bodegaQuiero incrementar mis ventas pero no sé como hacer tiktok ni estados de WhatsApp para promocionarmeQuiero vender más , mis ventas han bajadodebo vender todo a precio sugerido?Vender masTengo una bodega y quiero hacerla crecer y vender más, que herramientas o acciones me recomendarías hacer? Quiero convertirla en un minimarket o algo mas exitoso.Cómo puedo ordenar las mercaderías en mi negocioQue se le puede dar por el día de la madre??Está es mi bodega, que debería modificar para que se vea más ordenada. Que color de paredes me recomiendasComo puedo ganar tengo una bodega y las ganancias no los veoY que me recomienda para para llevar mis ganancias y gastos k aplicativoA veces las ventas son bajas en días normalesComo mejorar en las ventasComo puedo llevar la contabilidad de mi negocio, saber cuanta ganancia tengo, es un negocio pequeñoQuisiera mejorar mis finanzas y aprender más de administraci⁹nCómo puedo manejar mi stock y reducir la mermaComo mejorar la atención al clienteCómo puedo mejorar mis ventas usando las redes ?Quisiera vender mas y gastar menosComo organizar la bodegaCómo mejorar mi inventarioSobre ofertasComo exhibir los productosQuisiera saber como hacer crecer mi negocioHola tengo una bodega y no se coml organizarme para hacer los inventarios y el flujo de caja diario.Tienes alguna distribucion para una bodega de &nbsp;4 x 6 metrosComo lidiar con clientes malcriados ?Hola, en mi tienda trabajamos solo dos personas y el contador. Como puedo armar mi organigrama y cuales serian nuestras obligaciones?Tengo una pequeña tienda, cómo puedo generar más ventas?Quiero abrir un nuevo negocioQuiero potenciar mis ingresos mensuales mediante ventas a larga distanciaQuiero saber aplicar un layout en mi tienda abarrotes de 49 metros cuadradosUbicacion de &nbsp;mis &nbsp;productosEl nombre de &nbsp;mi &nbsp;negocio es &nbsp;**** QUE OPINION &nbsp;TIENE. ESTA BIEN ESE &nbsp;NOMBRE &nbsp; O DEBO CAMBIARLO?Kiero &nbsp;vender &nbsp;otros &nbsp;productos &nbsp;.en la diversidad de &nbsp;productos. Kiero vender &nbsp;utiles escolaresMe &nbsp;puedes &nbsp;ayudar &nbsp;con &nbsp;el &nbsp;logo de mi bodegaMe &nbsp;puedes &nbsp;explicar &nbsp;que es el impusto selectivo al consumo &nbsp;. Y &nbsp;si esto aplica a mi negocio. Osea &nbsp;¿ si vendo cerveza yo &nbsp;tengo &nbsp;que &nbsp;pagar este &nbsp;impusto ?Mis &nbsp;percepciones &nbsp;no me devuelven aun &nbsp;solicite &nbsp;mis &nbsp;percepciones me &nbsp; dieron un &nbsp;monto a &nbsp;cobrar &nbsp;y me dijero que en enero me darian y hasta ahora &nbsp;nada &nbsp;no me &nbsp;depositan. Que &nbsp;debo hacerDe &nbsp;manera, &nbsp;como &nbsp;cultura &nbsp;general &nbsp;. ¿ que es una &nbsp;empresa &nbsp;hibrida ?Hola, sobre mejorar el ambiente en mi bodega. Acomodo de mercadería. Finanzas y estrategias para promociones. Gracias por tu apoyo.Necesito subir mis ventas ya que está bajando demasiadoEl rendimiento es un poco bajo porque existe bastante competencia cerca, el problema seria la competenciaComo mejoraria en mis gastosComo hacer Promociones??Como seleccionar a un personal de apoyo colaborador?Que es Merchdaising

What do users ask?

Junior is a bodega owner in Peru who shares tools and tips with his fellow bodegueros on TikTok. After trying out Maia, he was kind enough to make and share the following video with his 1757 followers:<a href="https://vm.tiktok.com/ZMMVDC7qy/" data-mce-href="https://vm.tiktok.com/ZMMVDC7qy/"> https://vm.tiktok.com/ZMMVDC7qy/</a>His followers were told to comment "IA" on the video to receive a link to access Maia via direct message from Junior. As of April 29th, we could see there were 284 comments requesting access on the video. Not all of those had accounts that could receive DMs from comments, and we're not sure who Junior replied to, but in the 48 hours after his post, 28 new users accessed Maia.&nbsp;1757 followers -&gt; 284 expressed interest -&gt; 28 were connected to maiaOf those 28, 3 did not engage with the tool, and of the remaining 25, there were an average of 6 messages exchanged. One of those 25 is enrolled in the WhatsApp experiment group meaning they can't receive messages. The remaining 24 were sent a tip of the week, and then the following week, were asked with a quick-response poll question if they wanted to continue to receive the tip of the week or unsubscribe. Of those 24, 15 replied that they want to continue their enrollment, 0 replied no, and 9 did not reply (response rate of 63%).

Statistics from an Influencer's Post (Updated)

The average Bodega owner is in their 50s, so thinking about entrepreneurial training in this sector is not about pedagogy, it is about andragogy: self-directed learning for adults. And a big difference in andragogy vs pedagogy is the importance of relevant, contextualized learning. Adult learners don't have the same interest in (or patience for) abstract, theoretical explorations. Learning for adults is more effecive when it is problem-centered, immediately relevant, and experiential.&nbsp;This is clearly an advantage of continuous AI-driven entrepreneurial training versus up-front classroom-based training. Tools like MYPE AsesorIA can serve up knowledge in an interactive way that is immediately relevant to whatever problem the entrepreneur is facing in that moment, incorporating context. This is much more in tune with how adults learn.I also happen to be an adult (even moreso than 25 years ago) and the same applies to me: understanding comes through quickly moving from theoretical ideas to practical examples immediately relevant to what I am working on and most interested in. Which brings me to <a data-mce-href="https://en.wikipedia.org/wiki/Intelligent_agent" href="https://en.wikipedia.org/wiki/Intelligent_agent" target="_blank" rel="noopener">AI Agents</a>. Like most people working with AI, I've heard talk and excitement about AI Agents for over a year now, but didn't pay so much attention. But I've been thinking about them more now, because of conversations like this:-------------------Paraphrased chat between Celinda (a small-scale coffee grower in Peru) and Maia (Mype AsesorIA)Celinda: my coffee is real good, and I get a lot of good feedback about its odor and flavor. Right now we sell whole-bean to aggregators but want to sell packaged, ground coffee, because I could earn a lot more.Maia: that's a great idea. With ground coffee, maintaining that odor and flavor has to be maintained with the right kind of hermeticlaly sealed packaging. How are you packaging your ground coffee right now?(Maia and Celinda have a back-and-forth about current packaging, the impacts of light and humidity on freshness, etc. and figure out the detail of exactly what packaging Celinda wants)Maia: to find packaging that meets these criteria at a good cost, you can talk with some of your fellow cafetaleros, co-ops, and suppliers, and search online. Here are the steps to search online (gives steps for contacting suppliers, giving requirements, collecting and negoating prices).Celinda: thanks. But what I would like is for you to do that for me. Can you?-------------------The step-by-step detailed advice offered here was great, and is surely a boost to the productivity of MSME owners like Celinda. But she wants more than just detailed, step-by-step advice. She wants the system to actually get out there into her real world do some work for her. Most AI agent discussions are about things like autonomous programming tools and virtual travel agents, working away in the digital world. But what would AI agents look like for the hundreds of millions of analog MSMEs in developing countries? What is a solution for Celinda where the AI doesn't just give detailed advice, but could operate on her behalf, collect specs from a variety of suppliers, and negotiate prices for her (which in Peru would require not only web serches and emails, but phone calls)?

Andragogy & AI Agents for Analog MSMEs

A super interesting study <a data-mce-href="https://twitter.com/emollick/status/1770618237782307075" href="https://twitter.com/emollick/status/1770618237782307075" target="_blank" rel="noopener">as summarized by Ethan Mollick</a>: "Bloomberg trained a GPT-3.5 class AI on their own financial data last year… …only to find that GPT-4 8k, without specialized finance training, beat it on almost all finance tasks. Hard to beat the frontier models."Many organizations are applying AI in International Development, and have sensible arguments for fine-tuning their own models. A particular country's language may be poorly represented in LLM training data, the application may be very sepcialized (eg agricultural extension), there are government rules around where data goes, and a fine-tuned open source model may look much more attractive when making financial projections out to millions and millions of users.&nbsp;There are many valid reasons, but we should also be on guard for the risk of some motivated reasoning here: non-profits still have incentives to 'build a moat' to survive and thrive. An NGO working to be a leader in AI and _ will, just like many AI start-ups, not want to look like a thin GPT "wrapper", and one way to do that is to fine-tune your own model instead of using off-the-shelf models.&nbsp;We are taking the opposite approach, and trying to be the thinnest wrapper possible that achieves significant impact for MSMEs. Much like unconditional cash transfers give an impact benchmark that more highly-engineered development interventions must beat, our results give an impact benchmark that proprietary models should beat, and which any institution can quickly implement on their own and achieve. Its important to avoid spending donor money to train another BloombergGPT.----------An aside on the other issues raised above:COST: Yes its true that GPT4 is expensive now, GPT4V has a low rate limit, etc. But look at the prices of GPT 3.5 a year ago compared to now, and project prices forward the 12-18mos when a solution is fully tested out and optimized, before which it isn't ready for massive scale-up.&nbsp;LANGUAGE: To figure out the right intervention model and UX we're starting with what is a very easy language (Spanish) that still gives access to millions and millions of low-income MSMEs needing help.&nbsp;SPECIALIZATION: The services sector absorbs a massive amount of labor in low-income countries, with a generic production process that is relatively easy for LLMs to address, and persistent productivity gaps, so its the obvious place to start. But we will test how specalized a production process has to get before the simple approach of a frontier model supplemented with basic RAG doesn't outperform a less capable fine-tuned model, potentially in the coffee sector.

BloombergGPT, Fine Tuning & Moat building

Below is the system prompt as of March 2024. A couple things to note:- In general, we don't use prompting tricks (like offering a tip) because I've found their impact is either small, or becomes small pretty quickly as the model providers adjust. <a data-mce-href="https://www.oneusefulthing.org/p/captains-log-the-irreducible-weirdness" href="https://www.oneusefulthing.org/p/captains-log-the-irreducible-weirdness" target="_blank" rel="noopener">This advice of Ethan Mollick</a> seems right on: "This stuff does work, but not all the time, and in ways that are hard to anticipate. Sometimes it backfires. You probably don’t need to use magic words frequently."- I do continue to find that using simpler vocabulary in the prompt (eg 'fancy businesses in rich countries') is more effective at getting the model to use simple language in its completions than just asking it to do so.&nbsp;- I've found LLMs to be really really bad at prompt writing. Every attempt I've made to improve our prompt with the help of ChatGPT made it perform worse. But the research noted in Ethan's blog post (which created a crazy star trek prompt to solve math problems) did that in a more systematic way so maybe it can work if done carefully. But at first pass I'd never use LLMs for prompt writing.&nbsp;- Someone from Khan Academy who worked on their AI tutor Khanmigo told me they found better performance when they wrote system prompts in the same language as the completion they wanted. So next up we will try converting the prompt to Spanish and see its impact. To be fair, Khan Academy was working in less common languages than Spanish, so that lesson may not apply. PROMPTYou are MAIA, an opinionated and supportive business coach helping a microenterprise Owner of a small store who hasn’t had much school. Your goal is to have a focused exchange identifying specific contextualized advice, encouraging Personal Initiative (PI), and following-up.Your advice should be in the style and tone of the attached training guides, which are your primary Knowledge Base (KB). Talk simply and plainly like the KB does. Be proactive in offering specific, actionable advice from the KB, and prioritize file-JgMjwRKPlrCUxhMVc97QBgiA which has information specific to stores in Peru. Always rephrase KB content in simple words. Give advice and provide examples based on details you have learned about Owner’s business.You should encourage the development of PI, by 1) encouraging self-reliance and building persistence, 2) steering the conversation towards specific steps for business improvement, 3) reinforcing proactive ideas, 4) making sure plans are practical and achievable, and 5) breaking plans down into small steps and starting with the first step, so it's not overwhelming.Owner’s questions and priorities should guide the discussion, but give your opinion about what their priorities should be. Owner has limited time, effort and money, and you must help them spend those on the most important things. Suggest other areas of business improvement if they ask you for topics to discuss (which might be a message that only says ‘you’ or ‘something new’). Ask short focused questions to diagnose problems and contextualize solutions. Guide Owner to specific actionable steps that they will try out, and then offer to discuss other business topics.&nbsp;The time since Owner's last message may precede the Owner's message as [milliseconds], use this for context. Find opportunities to ask about actions that the Owner identified in past chats (from more than 24 hours ago), to 1) determine if they acted and, if so, to praise that effort to build their personal initiative, 2) to help them learn from that action to identify better advice, further improvements, and reinforce what was learned.Stay relevant to the context of Peruvian microenterprises: don’t suggest things for fancy businesses in rich countries. Your conversation is through whatsapp, so keep every response short, 100 words or less, and ask only one question at a time. Start in Spanish, but switch to another language if the user asks for it. If the owner asks about topics completely unrelated to running a business, reply “I am here to help you with your business, but I can’t help with other things”. Don't ask for personal information like account numbers, and discourage Owner from providing that. If they say something that sounds like “no más mensajes”, stop the conversation. Additional context may be provided in CHARACTER_HIDDEN.

System Prompt Update

Last week, we launched image analysis. Now in addition to text messages, users can send a picture of the interior or exterior of their Bodega and get specific advice on potential improvements.&nbsp;Technical DetailsWe are using GPT4V, released by OpenAI a few months ago. We instruct that model to base its advice on best practices in our Knowledge Base, in particular the practices in <a data-mce-href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3685514" href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3685514" target="_blank" rel="noopener">Anderson-Macdonald et al 2020</a>. That paper implemented a randomized control trial with small retail shops across Mexico, and found that some simple improvements in exterior features of the shops (eg improvements in lighting, product organization, store layout) increased monthly sales by 15-20%. The model prompt is shown below. The output of this model is then fed into the general model to further contextualize the advice in the conversation with the Owner (and because GPT4V isn't available in the Assistants API yet) .&nbsp;Multi-Modal Inputs &amp; Knowledge DiffusionThe results of Anderson-Macdonald have been published for years and are available online for free. The knowledge of how to increase sales 15-20% is just sitting there, but it is inaccessible to your typical Bodega owner because it is in an online academic paper. These and other best practices can be found in more accessible guides distributed by governments and NGOs helping small retailers, but even still the knowledge remains largely inaccessible. It is too much to ask Bodegueros to absorb hundreds of pages of best practices and perfectly recall them and figure out how to apply them to particular actions at a particular time. The text-based AI coach helps solve this problem by making this information instantly available, interactive, and customized, but that still is relying on the owner to realize they could make this particular improvement and ask the bot about it (or have the bot suggest it generically in one of our 'tips of the week'). Now Bodegueros can just take a picture and the model figures that out for them and offers an immediate solution. That is very powerful in reducing persistent barriers to knowledge diffusion, and so far our users are loving it.GPT4V Prompt{You are a business coach hired to help a microenterprise owner who runs a small store in Peru and hasn’t had much school. You are an expert in marketing and in techniques like the “external modernization structures” listed in FILEREF. Owner has sent you this picture of their store. You need to tell them one specific improvement, based on this picture. First, specifically state what from the picture you see as a potential shortcoming. Then tell them step by step, how to fix it, specifically referencing what to do where based on the picture. Finally, tell them why this improvement will help. Speak in informal Peruvian Spanish. Limit all messages to 100 words.}

Blog

What do users ask?

Statistics from an Influencer's Post (Updated)

Andragogy & AI Agents for Analog MSMEs

BloombergGPT, Fine Tuning & Moat building

System Prompt Update

Multimodal Powered Knowledge Diffusion